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(57) ABSTRACT 

A system for scanning and digitizing large images using an 
optional reseau for accuracy without obscuring the image to 
be scanned. The system uses at least one CCD photoreceptor 
array which is fixed in a rigid position with respect to any 
accompany lenses and mirrors. In one embodiment, a first 
CCD photoreceptor array is used to scan the image while a 
second CCD photoreceptor array simultaneously scans the 
reseau. In a second embodiment, a single CCD photorecep- 
tor array is used to first scan the reseau and then to scan the 
image. One illumination source illuminates the reseau while 
second illumination source illuminates the image. The 
arrangement of the lens(es) and the photoreceptor arrays 
allows the determination of any displacement of the scanner 
along the X-axis, Y-axis, and Z-axis, as well as the deter- 
mination of any rotation of the scanner around the X-axis, 
Y-axis, or Z-axis. The position and attitude of the scanner, as 
determined by scanning the reseau, is used lo correct any 
errors in the resulting image that are caused by displacement 
or rotation of the scanner. A large image can be scanned in 
separate but overlapping swaths, the overlap being used to 
align the swaths to create a final seamless digital image from 
the assembled swaths. 

21 Claims, 29 Drawing Sheets 
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FIG. 2 
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FIG. 6 
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FIG. 5A 
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FIG. 5B 

11/28/2003, EAST Version: 1.4.1 



U.S. Patent Sep. ll, 2001 Sheet 7 of 29 US 6,288,801 Bl 



X 





11/28/2003, EAST Version: 1.4.1 



U.S. Patent Sep. ll, 2001 sheet 8 of 29 US 6,288,801 Bl 




11/28/2003, EAST Version: 1.4.1 



U.S. Patent Sep. ll, 2001 sheet 9 of 29 US 6,288,801 Bl 




FIG. 9 



11/28/2003, EAST Version: 1.4.1 



U.S. Patent Sep. ll, 2001 sheet 10 of 29 US 6,288,801 Bl 



o| 




11/28/2003, EAST Version: 1.4.1 



U.S. Patent Sep. ll, 2001 sheet 11 of 29 US 6,288,801 Bl 




FIG. lOB 
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FIG. IOC 
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FIG. lOD 
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FIG. 16 
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FIG. 17 



11/28/2003, EAST Version: 1.4.1 



U.S. Patent Sep. ll, 2001 Sheet 22 of 29 US 6,288,801 Bl 




FIG. 18 
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SELF CALIBRATING SCANNER WITH 
SINGLE OR MULTIPLE DETECTOR 
ARRAYS AND SINGLE OR MULTIPLE 
OPTICAL SYSTEMS 

5 

CROSS REFERENCE TO RELATED PATENT 
APPUCAnON 

This patent application is a continuation-in-part of 
copending U.S. patent application Ser. No. 08/518,920, filed 
in the U.S. Patent and Trademark Office on Aug. 24, 1995, 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

This invention relates to image scanning devices, particu- 15 
larly to image scanning for purposes of digitizing large 
visual images with multiple passes of a small scanner that 
digitizes adjacent portions of the image in sequential passes 
for storage in a computer memory or other data storage 
system and using a calibration device, e.g., a reseau, to 20 
position and align the adjacent portions of the scanned 
images accurately. Such devices include photogrammetric 
apparatus and prepress systems. 

2. Description of the Prior Art 

With the advent of digital computers, it has been found 
desirable to store complex object images, such as maps, 
photographs, documents, and the like as digital signals for 
storage in memory and on data recording media. Thereafter, 
the images can be retrieved from the memory or data 
recording media for reproduction, enhancement, scaling, 
displaying, or other processing. Scanning and recognition of 
text can be accomplished with relatively coarse mechanical 
position to pixel image registration. However, digitizing 
aerial photographs, radar images, and maps, for example, 
requires great precision and detail, especially because the 
stored digital object images can be processed by computers 
to produce scaled-up portions or enhanced sections to clarify 
or display detailed features. Similarly, great precision and 
detail can be required in graphic arts and color separation. ^ 

Scanning also has industrial applications, such as auto- 
mated manufacturing where parts are scanned to verify 
conformity of the parts to the specifications for their manu- 
facture. Accurate measurement and locations of holes on 
parts, for example, are an important application. It is also 45 
desirable to scan objects in segments and then merge the 
resulting images of the adjacent segments into composite 
images of the whole objects, which requires great precision 
and detail so as to avoid the appearance of "seams" or 
"splices" at intersections of adjacent images. 

The use of reseaus, Le., networks of fine lines or other 
reference marks on a sheet of glass, plastic film, or other 
material, to provide reference marks or points for scanned 
features has been adapted to such applications. In aerial 
photography, a reseau has been used within a camera to 55 
produce reference points on the photograph itself. Several 
problems are associated with such an approach and are 
discussed in U.S. Pat. No. 4,149,788. 

A prior art preferred method of impressing a reseau on an 
object image to be scanned is to overlay the object, such as 60 
a photograph or transparency that contains the image to be 
scanned, with the reseau so as to superimpose the reseau 
marks on the object image. In very fine, detailed work, 
however, the reseau marks can obscure or cover some details 
in the object image that are desired to be scanned and 65 
digitized. To address that problem, U.S. Pat. No. 4,928,169, 
which is incorporated herein by reference, discloses an 



,801 Bl 

2 

apparatus for scanning object images where the reseau is 
positioned directly atop the object image to be scanned. The 
reseau marks can be illuminated to make them visible and 
then scanned, digitized, and their positions stored in com- 
puter memory. Then, the reseau illumination is turned off to 
make the reseau marks invisible and, in turn, illuminating, 
scarming, digitizing, and storing the object image. However, 
that apparatus was never reaUy able to make the reseau 
totally invisible. Therefore, there was still some distortion of 
gray values and obscuring of some detail of the object image 
by the reseau marks, especially when digitizing at very high 
geometric resolutions, e.g., less than ten to twenty 
micrometers, and gray value precisions, e.g., to twelve 
binary digits. 

Another additional problem common to some prior art 
scanning methods including the method disclosed in U.S. 
Pat. No. 4,928,169, is that they use square arrays of photo- 
receptor elements to scan the object images. With such a 
square photoreceptor array, the anay must first be positioned 
over the area of the object image being scanned. All move- 
ment of the square array must then stop while that area of the 
object image is captured or "grabbed" and digitized. After 
the digitizing is completed for a particular area, the square 
array is repositioned so that it digitizes a new area of the 
object image, and it stops again while that new area of the 
object image is digitized. This method, referred to in the 
imaging and scanning arts as "stop and stare," is repeated 
until the entire object image is scanned or digitized. The 
"stop and stare" method requires a speed control capability 
to initiate and terminate movement of the photoreceptor 
array, which necessarily involves repeated accelerating and 
decelerating the moving photoreceptor array. This require- 
ment increases the complexity of the device and increases 
probability of errors due to mechanical limitations inherent 
in such speed controls and in the motor and drive assemblies 
that position the photoreceptor arrays. Furthermore, square 
photoreceptors used with the "stop and stare" method gen- 
erate an electrical signal for every photoreceptor element in 
the array. Square photoreceptor arrays that have 500 pho- 
toreceptor elements in each of 500 rows would, therefore, 
create 250,000 electrical signals simultaneously during each 
"stop and stare" step of the object image scanned. In tum, 
complex methods arc needed to process (amplify, filter, 
digitize, and store) all of the signals simultaneously before 
the square photoreceptor array can be repositioned to digi- 
tize another part of the object image. 

SUMMARY OF THE INVENTION 

Accordingly, it is a general object of the present invention 
to provide a system for image scanning and digitizing using 
a reseau for accuracy, but without obscuring the image to be 
scanned. 

A more specific object of this invention is to provide an 
image scanner and digitizer that uses a reseau for accuracy, 
while eliminating reseau marks from the object image and 
their effects of distorting the scanned object image. 

Another object of the present invention is to provide a 
high speed, yet highly accurate image scanner and digitizer 
that can scan and digitize large area object images at lower 
cost than would otherwise be possible if the photoreceptor 
must be positioned by a mechanically precise mechanism. 

Another object of the present invention is to provide a 
highly accurate image scanner using linear photoreceptor 
arrays without a need to position the linear photoreceptor 
arrays very precisely. 

Another object of the present invention is to provide a 
method and apparatus for determining position and attitude 
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errors for a scanning device when the scanning device is 
scanning an object image. 

Additional objects, advantages, and novel features of the 
invention shall be set forth in part in the description that 
follows, and in part will become apparent to those sidUed in 
this art upon examination of the following or may be learned 
by the practice of the invention. The objects and the advan- 
tages, may be realized and attained by means of the instru- 
mentalities and in combinations particularly pointed out in 
the appended claims. 

In accordance with the invention, two photoreceptor 
arrays are provided with optics systems for scanning — one 
array scanning the object image and the other array scanning 
a reseau which is placed outside the imaging view of the 
object image scanner. The reseau marks are not detected by 
the object image scanner and the object image is not detected 
by the reseau scanner. The reseau marks are used to deter- 
mine the scanner's position pC, Y, Z) and attitude (tip ip, roll 
CO, yaw a) accurately and precisely and to correct enors in 
the scanner's movements. 

Also in accordance with the invention, a photoreceptor 
array is provided with an optic system for scanning an object 
image, either simultaneously with a reseau, consecutively 
with a reseau, or without a reseau. Image matching and/or a 
job sheet can be used to further improve the accuracy of the 
resulting image, 

BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings, which are incorporated in 
and form a part of the specifications, illustrate the preferred 
embodiments of the present invention, and together with the 
descriptions serve to explain the principles of the invention. 
In the Drawings: 

FIG. 1 is an isometric representation of the essential 
mechanisms of a scanner according to the invention includ- 
ing an object with an image to be scanned mounted in fixed 
spatial relation to a reseau; 

FIG. 2 is a cutaway illustration showing the relationship 
of the movable structure comprising the scanning array and 
optics and the fixed structure of the object to be scanned and 
the reseau in spatially separated relation to each other; 

FIG. 3 is a block diagram of a control system for the 
scanner; 

FIG. 4 is an illustration of a reseau relative to several 
adjacent scan lines that form a swath; 

FIG. 5A is an enlarged illustration of mensuration points 
associated with a reseau scan swath showing the sources of 
error in location; 

FIG. 5B is an another enlarged illustration of mensuration 
points associated with a reseau scan swath showing the 
sources of error in location; 

. FIG. 6 is a representation of an alternate orientation of the 
object image and reseau according to this invention; 

FIG. 7Ais a line drawing showing the effect of tip and its 
detection; 

FIG. 7B is a line drawing showing one embodiment to 
detect tip rotation; 

FIG. 8 is a block diagram of a single scan arrangement for 
storing errors in the scan optics positioning and reseau 
errors; 

FIG. 9 is a representation of an alternative single optics 
scanner for simultaneously scanning an object image and 
reseau image so that the reseau image is not superimposed 
on the object image; 

FIG. lOA is a representation of a multiple optic scanning 
system for distinguishing between tip Aijj and translation AX 
errors; 
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FIG. lOB is a second representarion of a multiple optic 
scarming system for distinguishing between tip A\jj and 
translation AX errors; 

FIG. IOC is a third representation of a multiple optic 
5 scaiming system for distinguishing between tip A-\|) and 
translation AX errors; 

FIG. lOD is a fourth representation of a multiple optic 
scanning system for distinguishing between tip Aijj and 
translation Ax enors that also distinguishes between roll Aco 
10 and translation Ay errors; 

FIG. UA is a representation of an alternative scanner 
utilizing folded optics and a single lens to reduce the overall 
dimensions of the invention; 

FIG. IIB is a representation of an alternative scanner 
15 utilizing folded optics and two lenses to reduce the overall 
dimensions of the invention, while increasing the angle 
under which the reseau is being scanned; 

FIG. 12 is a representation of another alternative scaimer 
utilizing a different folded optics variation and a single lens 
20 to reduce the overall dimensions of the invention; 

FIG. 13 is a representation of the hnear photoreceptor 
array scanning a single reseau mark; 

FIG. 14 is a representation of the Une fitting function 
performed by the feature isolation method; 
25 FIG. ISA is a representation of the overlap of the input 
pixel swath with the output pixel array; 

FIG. 15B is a representation of the transformation process 
from the input pixel swath with the output pixel array; 

. FIG. 16 is a representation of the relationship between a 
30 point P on the reseau and it's corresponding point F on the 
photoreceptor array scanning the reseau; 

FIG. 17 is a representation of the projection of the point 
P' on the photoreceptor array onto the reseau plane contain- 
ing the point P; 
35 FIG. 18 is a representation of the relationship between 
adjacent and overlapping swaths on the object image created 
by the photoreceptor array and scan head scanning the 
object; 

FIG. 19 is a representation of common features in two 
40 overlapping swaths creating by scanning the object image; 
FIG. 20 is a representation of overlapping scan lines 
between adjacent and overlapping swaths on the object 
image created by the photoreceptor array; 
FIG. 21 is a representation of match points in the vicinity 
45 of a particular scan line for swaths on the object image 
created by the photoireceptor array scanning the object; 

FIG. 22 is a representation of the ahgnment process of 
scan lines fi"om adjacent swaths of the object image; 
FIG. 23 illustrates a job sheet that can be used with the 
50 apparatus and method of the present invention to improve 
scaiming accuracy; 

FIG. 24 illustrates the job sheet of FIG. 23 with an object 
image to be scanned overlaying the job sheet; and 
FIG. 25 is a representation of another alternative scanner 
55 utilizing a flippable lens to provide different image resolu- 
tions. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENTS 

60 For ptirposes of explanation, object images as they relate 
to this invention can include visual images of objects, such 
as aerial, medical, or other photographs, radar images of 
earth's surface, geographical terrain or objects in the terrain, 
maps, documents, graphic art work or any other graphics or 

65 pictures that are to be digitized and stored in an electronic 
memory or other data storage system for later recall, display, 
or manipulation. An object image may also be a three- 
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dimensional object, sucb as a manufactured part, but only the scanner measures the pixel's gray or color value and, 

two-dimensional scanning is performed. according to the scanner location, the address of each pixel 

A scanning apparatus 100 according to this invention, as is calculated for storing pixels in the proper location, 

illustrated in FIG, 1, scans an image 104 on an illuminated Scanning along several paths and misalignment of the 

object 103 with an array of photosensor devices (not shown 5 scaiming head may cause some overlapping of scan swaths, 

in FIG. 1, but contained in the movable scan head 101) that so that some pixels near an edge of the swath might be 

are focused by optics (also not shown in FIG. 1, but included in more than one scan swath. The raster map type 

contained in the movable scan head 101) on the object image of storage of the pixels, however, will correct for any 

104. It also has optics that scan a reseau 105, which reseau overlap, because any pixel that is scanned more than once by 

is outside the field of scan of the scanning optics for the different swaths will, after the positional errors are 

object image 104, as will be described in more detail below. corrected, be stored in the proper memory location, viz., in 

The separate optics for scanning the reseau 105, which is the same location at which it was stored by virtue of being 

spatially separated from the object 103, avoids any obstruc- scanned by a previous swath. Hie reseau marks 106 are used 

tion of the object image 104 by the reseau marks 106 on tbe to make the corrections for these positional errors, as will be 

reseau 105. explained in more detail below. SufSce it to say at this point 

The scanner 112 used with this invention, which can be that a raster sweep or swath of the image photoreceptor array 

contained in movable scan head 101 of FIG. 1, is best seen 211 to detect and digitize a corresponding series of scan lines 

in FIG. 2. In this embodiment, the scanner comprises two 221 of the object image 104 moving in the X-axis 115 

arrangements of linear photoreceptor arrays 211, 215. The direction, as indicated by arrow 222 in FIG. 2, is accompa- 

photoreceptor array 211, which is oriented toward the object 20 nied by a complementary raster sweep or swath of the reseau 

103, may comprise m rows of n photoreceptor elements 212 photoreceptor array 215 to detect and digitize reseau marks 

(mxn), which photorec^tor elements 212 are individual 106, which are positioned in fixed spatial relation to the 

photoreceptors, such as photosensitive charge-coupled object 103. The swath 225 is contained within the dashed 

devices (CCDs), photodiodes, or any type of light-sensitive lines 1800, 1804 shown in FIGS. 2, 18, and 20. Therefore, 

device for producing an electrical signal in proportion to 25 as the swath 225 containing the scan line 221 is collected in 

light incident thereon. The photoreceptor array 211 is an the path indicated by arrow 222, the complementary swath 

mxn array of photoreceptor elements 212 with m equal to 227 containing the scan line 223 corresponding to pholore- 

one (1) for black and white object images or three (3) or cq)toT array 215 sweeps a raster path indicated by arrow 224 

more for color (or enhanced black and white by averaging as it detects the positions of the reseau marks 106 in that 

the three or more values) and n arbitrarily large, typically 30 swath 227. The swath 227 is contained within the dashed 

100, 1000, 2000,4000, 5000, 6000, or 8000 elements. The 14 fines 1801, 1803 shown in FIG. 2. After completing the 

photoreceptor elements 212 of photoreceptor array 215 swath 225, the scaimer 112 moves laterally in the Y-axis 119 

cannot be seen in FIG. 2, because they are exposed down- direction before making a return swath 225' in the opposite 

wardly toward the reseau 105. Since photoreceptor array 215 direction, collecting image information as indicated by the 

only detects ihc reseau marks 106 on the reseau 105, a single 35 scan line 221' moving as indicated by arrow 222', while also 

row of photoreceptor elements 212 is sufficient. collecting complementary reseau mark positions as indi- 

Consequcntly, the photoreceptor array 215, m is equal to cated by the scan fine 223' moving as indicated by arrow 

one. Also, the number n of individual photoreceptor ele- 224' to create the swath 227'. Specific spatial relations of the 

ments 212 in photoreceptor array 215 can be, but does not reseau marks 106 to each other and to the optical head forme 

have to be, the same as the number n of individual photo- 40 203 can be used to properly and accurately afign pixels ts 

receptor elements 212 in photoreceptor array 211. The linear detected in the swath 225' containing the scan fine 221' in 

photoreceptor array 215 is illustrated in FIG. 2 as being relafion to corresponding pixek of the object image 104 

shorter than the linear photoreceptor array 211, thus having detected in the swath 225 containing the scan hue 221. 

fewer photoreceptor elements 212 than fincar photoreceptor Referring now to the scannmg apparatus 100 in FIG. 1, a 

array 211. The operative goal is to have the finear photore- 45 movable scan head 101 supports and encloses a scanner 112, 

ceptor array 215 long enough to detect and image a sufficient as shown in FIG. 2. An object 103 containing an object 

portion of reseau 105 to provide reseau mark 106 locations image 104 to be scanned is shown in FIGS. 1 and 2 

that are recognizable as specific locations in relation to the positioned above the movable scan head 101 (FIG. 1) and 

system frame and mechanical mensuration components. In scanner 112 (FIG. 2). The reseau 105 is positioned below the 

other words, when the mechanical system positions the 50 movable scan bead 101 and scanner 112 and is scanned 

finear array in a specific posifion, the sunultaneously with the object image 104. The object 103 

Detection of pixels is also shown in detail in U.S. Pat. No. and reseau 105 are mounted immovably m or to the fi-ame 

4,928,169. The pixels are stored, for example, in raster member 201 so that they are also immovable in relation to 

mapped memories. In the system described in that patent, each other. An object image backlight 107 is positioned over 

each pixel of an image, represented by one or more binary 55 object 103 or in the movable scan head 101 for iUumination 

digits depending on the gray scale or color resolution, is of the object image 104 and an optional reseau backlight 109 

stored in a memory which can be visuafized as a rectangular is positioned under the reseau 105 to illuminate the reseau 

or square array of storage ceUs, each individually address- 105. In this illustration, the object 103 is considered to be a 

able. If an object image 216x280 square milfimeters (SYtxll transparency or plastic film that contains the object image 

square inches) is to be scaimed to an accuracy of five eo 104, so illumination of the object image 104 is accompfished 

micrometers per pixel, then 2.42 biUion storage locations with a backlight source 107 that radiates fight through the 

would be required. Data compression techniques are known object 103 to iUuminate the object image 104. Alternatively, 

in the art to reduce the storage requirements, but for pur- an object image that is on an opaque object, such as a 

poses of explanation, it is considered that the requisite conventional photograph developed on photographic paper, 

amount of memory is avafiable. gs would of course need front illumination, which could be 

Since each pixel on the object image 104 being scaimed from a light source moimted anywhere on or in proximity to 

and digitized has a corresponding location in the memory, the scanner 112 that does not obscure the scanner field of 
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view, which would be well within the skill and capabilities 
of persons skilled in this art. For example, the alternate front 
light source 107' shown in FIG. 2 would illuminate the front 
(bottom) surface of object 103. 

An object image backlight guide bearing 110 and a reseau 5 
backlight guide bearing 111 support the distal ends 122, 126 
of the respective backlight support frames 120, 124 for the 
object image backlight 107 and reseau backlight 109. The 
guide bearings 110, 111 are mounted in a system frame 140, 
part of which is shown cut away in FIG. 1 to reveal other 
components, are described herein. The proximal ends 128, 
130 of respective backlight support frames 120, 124 extend 
from opposite ends 202, 205 of a rigid mounting frame 
member 201, which is attached to the main carrier housing 
127. 

The main carrier housing 127 is movably mounted on 
elongated guide bearings 121, 123, which allow movement 
of the main carrier housing in the X-axis 115 direction. The 
guide bearings 121, 123 are supported by the system frame 
140. The movable scan head 101 is movably mounted in the 
main carrier housing 127 for movement back and forth in the 
Y-axis direction, as indicated by the arrow 119 in FIG. 1. 
Example bearing and drive mechanisms for moving the 
main carrier housing 127 in the X-axis 115 direction and for 
moving the movable scan head 101 in the Y-axis 119 25 
direction can include worm gear and follower components 
driven by stepper motors similar to those shown and 
described in U.S. Pat. No. 4,928,169, which is incorporated 
herein by reference, or by any other suitable mechanisms 
and components. 3q 

The reseau 105 is held in an immovable position in 
relation to the system frame structure by a suitable reseau 
mounting structure 142 such that movement of the main 
carrier housing 127 in the X-axis 115 direction also moves 
the reseau backUght 109 in unison under the reseau 105. A 35 
similar reseau mounting structure, which cannot be seen in 
FIG. 1, is also positioned to support the opposite edge of the 
reseau 105. Likewise, the object 103 is mounted by suitable 
mounting brackets 144, 146 in immovable relation to the 
system frame 140, thus also in immovable relation to the 40 
reseau 105. The object image 104 can be sandwiched 
between two transparent glass sheets (not shown) for 
support, as would be obvious to persons skilled in this art. 
Further, as mentioned above, as the main carrier housing 127 
moves in the X-axis 115 direction, it moves the object image 45 
backUght assembly 107, which is attached to the main 
carrier housing 127 by frame member 201, in unison in the 
X-axis 115 direction in relation to the object 103. 

A removable pin 117 connecting the proximal end of the 
support frame 120 to the upper end 202 of frame member 50 
201 permits the object image backlight 107 to be removed 
to accommodate mounting and removing an object 103 to be 
scanned. 

The main carrier housing 127, the backlights 107 and 109, 
and the movable scan head 101 move in unison in the X-axis 55 
115 direction relative to the object 103 and the reseau 105 
which are held securely by the mounting brackets 144, 146 
and system frame 140 so that their positional relationship to 
each other remains cxinstant. Hie movable scan head 101, 
which contains the optical scanning components to be 60 
described in more detail below, is also movable in the Y-axis 
119 direction in relation to the object 103, reseau 105, main 
carrier housing 127, and system frame 140, as described 
above. The positions of the object 103 and reseau 105 can be 
interchanged (not shown) or even juxtaposed as illustrated in 65 
FIG. 6, or they may be placed on the same side of the 
scanner head as described below with respect to FIG. 9. 
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The details of the optical components of the scanning 
apparatus 100 are best seen in FIG. 2, where the movable 
scan head 101 is shown positioned between the object 103 
and the reseau 105 and with two sides and the bottom cut 
away to reveal the optical components. The optical compo- 
nents comprise an optical head frame 203 mounted to a wall 
152 of the movable scan head 101, and it supports an object 
scanning photoreceptor array 211 oriented toward the object 
103 and a reseau scanning photoreceptor array 215 oriented 
toward the reseau 105. The optical head frame 203 also 
mounts and supports a lens 207 for focusing the object 
image onto the object scaiming photoreceptor array 211 and 
a lens 209 for focusing the reseau marks 106 onto the reseau 
scanning photoreceptor array 215. With the optical head 
frame 203 mounted on the wall 231 of movable scan head 
101 in this manner, any X-axis 115 direction or Y-axis 119 
direction motion imparted to the movable scan head 101 is 
also imparted to the photoreceptor arrays 211, 215 and 
lenses 207, 209. 

The optical head frame 203 can also be mounted on the 
wall 152 in such a manner that it is movable up and down 
in relation to the movable scan head 101 in the Z-axis 117 
direction, as indicated by the arrow 231, for effecting proper 
optical positioning and fociising of the object image 104 on 
photoreceptor array 211. The reseau lens mount 233 on the 
lower portion of the optical head frame 203 can also be 
mounted in such a manner that reseau lens mount 233 and 
lens 209 are movable up and down in relation to the optical 
head frame 203 in the Z-axis 117 direction, as indicated by 
the arrow 235, for focusing the reseau marks 106 on the 
photoreceptor 4) array 215 after the object image 104 is 
focused on the photoreceptor array 211. Factory settings or 
one-time settings of these Z-axis adjustments may be suf- 
ficient to obtain and keep the desired distances and focus for 
the object image 104 and reseau marks 106, or they can be 
made user adjustable, as desired. If user adjustment is 
desired, suitable mountings and mechanisms to effect the 
movable mountings of optical head frame 203 and lens 
mount 233 can be easily used or adapted from those Z-axis 
mountings described and shown in U.S. Pat. No. 4,928,169, 
which is incorporated herein by reference. Therefore, further 
description of Z-axis drive or control components for mov- 
ing the optical head frame 203 and lens mount 233 up and 
down in the Z-axis is not required here for an understanding 
of the principles and components of this invention. Other 
adjustments can also be provided for the lenses 207, 209, as 
desired by persons skilled in this art. 

The object image optical system 207 scans a swath 225 on 
the object image 104, and the reseau optical system 209 
scans a swath 227 on the reseau 105. The swaths 225 
containing the scan line 221 and the swath 227 containing 
the scan line 223 are not necessarily the same width in the 
Y-axis 119 direction. The width of the swath 225 on the 
object 103 is balanced to optimize pixel detail desired in the 
detected object image 104 with sufficient width to gather 
image from a reasonably large area in a swath. The width of 
swath 227 on the reseau has to be sufficient to gather images 
of a sufficient number of reseau marks 106 within the path 
224 of the swath to create accurate positioning coordinate 
information for use in correlating spatial positions of image 
pixels gathered in one swath with object image pixels 
gathered in another swath across the object 103. 

Tlic width of the swath 225 on the object 103 in the Y-axis 
119 direction is partly dependent on the focal length of the 
lens 207 and the position of the lens 207 relative to the object 
103. The width of the swath 225 on the object 103 in the 
Y-axis 119 direction can be altered by replacing the lens 207 
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with a another lens (not shown) having a different focal more detail below. Wiring for carrying the electrical charges 

length and by repositioning the new lens relative to the from the CCD elements are well known to persons skilled in 

object 103 accordingly so that the catire swath containing this art and do not form any part of this invention, so they 

the scan line 221 remains focused on the photoreceptor array are not shown in the drawings or explained further herein. 

211. An optional embodiment of the present invention 5 The length of the photoreceptor arrays 211, 215 and 

includes a second lens (not shown), and possibly additional complexity, such as multiple-row arrays for color imaging, 

lenses (not shown), having a different focal length than the are well known design choices, thus are not part of this 

lens 207 that can be positioned so as to replace the lens 207 invention, but may be used in making and implementing the 

and alter the width of the swath 225 on the object 103 in the invention by persons having ordinary skill in the art, given 

Y-axis 119 direction. The additional lens(es) (not shown) the teachings of this invention. Further, increased resolution 

provides the capability to alter the resolution of the resulting obtainable by multiple linear arrays along the line of scan 

image copy of the object image 104 and to alter the time motion is also a well known expedient that can be imple- 

required to scan the object image 104. In addition, this mented with this invention by persons having ordinary skill 

embodiment ehminates the requirement for "zooming*' that in the art, once they understand the principles of this 

is common to many single lens systems that provide the invention as described and shown herein. Therefore, while 

capability of changing the resolution of the resulting image such expedients are considered to be useful in implementing 

copy of an object image. this invention, they are not part of this invention and need 

Another alternate embodiment with a single lens system not be described in more detail herein. A block diagram of 

is possible as shown in FIG. 9 v^th the photoreceptor arrays a control and processing system that can be used with the 

211 and 215 on the same side of the lens system 901, but at ^ invention is shown in FIG. 3. The fixed system frame 140 is 

respectively different distances from the lens system 901. shown with the object image 104 and the reseau marks 106. 

This anangement establishes the plane of the object 103 and The optical head frame 203 includes the CCD photoreceptor 

the plane of the reseau 105 at respectively different distances arrays 211 and 215. The backlights (illuminators) 107 and 

on the same side of the lens system 901. The positions of the 109 are controlled by a controller 301. 

object 103 and the reseau 105 and their respective photore- ^ piG. 4 provides an illustration of an enlarged segment of 

ccptor arrays 211, 215 can be switched. reseau 105. Reseau 105 M includes a grid composed of two 

The photoreceptor arrays 211 and 215 in FIG. 9 with the sets of reseau marks 106, all of which lie in the same plane 

lens system 901 are held by a frame 907 and the abject as reseau 105. The first set (the NW/SE set) of reseau marks 

image 104 and reseau 106 are supported by a second frame 106 is comprised of parallel reseau marks 505 that extend 

908 to permit relative movement between the photoreceptor 30 NW/SE in this illustration. The reseau marks 505 in the 

arrays 211,215 and object 103 and reseau 105. Again, NW/SE set are separated by a distance s^. The second set 

suitable adjustable vertical or Z-axis mountings and, if (the SW/NE set) of reseau marks 106 is comprised of reseau 

desired, drive mechanians can be adapted readily by per- marks 507 that extend SW/NE in this Uluslration. The reseau 

sons skilled in this art from the mounting structures and marks 507 in the SW/NE set are separated by a distance Sj. 

mechanisms shown and described in FIG. 2 and in U.S. Pat. 35 The distances s^ and s^ are preset by manufacturer and the 

No. 4,928,169, which is incorporated herein by reference, A two distances can be equal but they are not required to be 

scan line 917 on the object image 104 is scanned simulta- equal. The reseau marks 505 in the NW/SE set are illustrated 

neously with a scan line 915 on the reseau 105. The perpendicular to the reseau marks 507 in the SW/NE set, 

photoreceptor arrays 211, 215 and object 103 and reseau 105 which is convenient, but not essential to this invention. As 

may be offset or spaced apart from each other to some extent 40 shown in FIG. 2, the reseau marks 106 are oriented on reseau 

as shovra in FIG, 9 to aid in the separation and noninter- 105 such that they are at approximately forty-: five degree 

ference of an image from object 103 with the image of angles to swath 227, which is also convenient, but not 

reseau marks from the reseau 105. The amount of offset or essential ,to the invention. A few degrees variance from 

distances between the respective components (photoreceptor forty-five degrees is desired to avoid having the CCD array 

arrays 211 and 215, object 103, and reseau 105) is limited or 45 215 from passing over and scanning two or more reseau grid 

determined by the parameters of the lens system 901, as will intersections 506 at the same time, 

be readily apparent to persons skilled in this art. As shown in FIG. 5A and FIG. 5B, which illustrate an 

In an implementation as shown in FIG. 9, the reseau even further enlarged segment of the reseau 105, the rect- 

image will disappear to the object image scarmer if the angle position 501 represents the image one CCD photore- 

distance between the object image 104 and the reseau 105 is 50 ceptor array 215 looking at the reseau (FIG, 2) as the 

comparable to the focal length of the lens system 901. For photoreceptor array 215 sweeps across successive SW/NE 

a 50 millimeter lens system, the distance would be on the reseau marks 505 (designated individually in FIG. 5A and 

order of 30 milhmeters to insure the reseau image did not FIG, 5B as SOSa-SOSc) and across the successive NW/SE 

appear on the photoreceptor array 215. This arrangement has reseau marks 507 (designated individually in FIG, 5A and 

the advantage of fewer optic elements and better geometry 55 FIG. 5B as 507a-507Z)). In a more abstract sense, which is 

with minimal interference between scanned images. appropriate for mathematical calculations, the rectangle 501 

The photoreceptor elements 212 and photoreceptor arrays can represent the position of the scan head 101 at one 

211 and 215, as illustrated in FIG, 2 and discussed briefly location along the swath 227 (FIG. 2) as it sweeps either 

above, are exemplified as photosensitive charge-coupled north or south across the reseau 105, The smaller angle 

devices (CCD array elements) which are commercially 60 between the reseau marks 505 and the scan path position 501 

available. In FIG. 2, as the movable scan head 101 moves the is denoted as 4. The angle 4 is preset by the user or the 

optical, components to sweep the scanned swaths 225 and manufacturer and will be discussed further below. Better 

227 over the object image 104 and reseau 105 being results and accurate location calculations the scan head 101 

scanned, the incident light on each CCD photoreceptor and for pixel correlation when scanning the object image 

element 212 creates an electrical charge proportional to the 65 104 can be obtained if the angle 4, is at an angle slightly 

intensity of the incident light. The magnitudes of the charges different than forty-five degrees, for example, forty -seven 

are then transferred to processing elements as explained in degrees, particularly if distances s^ and S2 are equal. 315 
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Such scan head 101 location and pixel conelation steps arc Typical conditioning includes adapting the voltage range of 

described in more detail below. the analog signal so that it falls within the range allowed by 

As discussed above, the operation of scanning apparatus ADC 319 and ADC 325, "freezing^' the voltage level in a 

100 includes scanning the object image 104 and reseau 105 sample-and-hold process prior to input to ADCs 319, 325, 

simtiltaneously with the movable scan head 101. As shown 5 correcting the known non-uniformities between the photo- 

in FIG. 3, the analog electrical signals created by photore- receptor elements 212, and applying dark current compen- 

ceptor arrays 211 and 215 are converted to digital electrical sation. The Operation Amplij5er ADS 11, manufactured by 

signals in data collection subsystem 317. The object image Analog Devices of Norwood, Massachusetts, and Erasable 

digital signal from analog-to-digital converter (ADC) 319 in Programmable Logic Device EPM7128, manufactured by 

the data collection subsystem 317 and the reseau digital suitable and typical CCD 

signal from ADC 325 in the data collection subsystem 317 support devices that can be used for the CCD support 

are farther processed and corrected by the radiometric f"""^^ ^21, 323 of this invention, and the use of such 

processingsystem327andthereseauprocessingsystem337 ^ ^ processmg is well 

respectively before they are transmitted and stored in the in e a . , . . , 

scan line and transform buffer 335, which serves as a 15 . Since the output version of the scanned^^^^^^^^ 

temporary high-speed storage area Hie radiometric process- ^ ^^^^5^ ^ computer, it is desirable to convert the 

* * -^uj-*!!--*- analog signals generated by the photoreceptors in CCD 

mc system 327 corrects errors m the digital obtect image 111 iie - * j 1 - 1 ^n. c ^t. 1 

.^f -.i- i.- arrays 211, 215 into digital signals. Therefore, the analog 

Signals created by inherent differences m the electromc . • ' ^ - , , , . p. „ r^r^T^ J • % i-^T 

^ r , / 1 ^. M , . object image signal outputs from CCD support circuit 321 

response of the photoreceptor elements 212, Similarly, the transmitted to ADC 319, which converts the analog 

reseau processmg system 337 corrects the digital reseau 20 object image signals for each photoreceptor element of the 

signals. The reseau processing system 337 also detemunes cCD array 211 into digital signals for each photoreceptor 

the geometric position of the center of each scanned reseau element. Hie digital signals are represented by a digital 

mark 106. The stored image and reseau data are transmitted number which has typically ten to twelve bits or more. In a 

from the scan line and transform buffer 335 to a geometric twelve-bit digital output signal, the values range between 

processing system 347, which further corrects any distor- 25 zero and 4,095. Likewise, a) the reseau signal outputs from 

tions and geometric deviations in the digitized and stored CCD support circuit 323 are transmitted to ADC 325, 

image by referencing information created by scanning the converts the analog reseau into eight -bit digital signals. In an 

reseau 105 that indicates the actual positions of the scanner eight-bit digital output signal, the values range between zero 

112 (FIG. 2) when the respective image data was collected. and 255. It is possible for ADC 319 and ADC 325 to be part 

The digital output from geometric processing system 347 in 30 of a single, multi-channel analog-to-digital converter (ADC) 

FIG. 3 is then transmitted to an optional swath buffer and so that the same ADC may be used to convert the analog 

multiswath formatter 355, which creates images in the object image signals and the reseau signals. It is also 

format desired by the user. Each step of this process will be possible to use an ADC that converts analog signals to 

discussed in further detail below. digital signals using other than eight (8) or twelve (12) bits. 

As shown in FIG. 3, object image backlight 107 and 35 Analog to digital conversion techniques are well known in 

reseau backlight 109 are controlled and activated by con- the art. 

troUer 301. As shown in FIGS. 1 and 2, as the scanner 112 The digital object image signals are transmitted from 

moves in the X-axis 115 direction, the moving positions of ADC 319 to the radiometric processing system 327, which 

the photoreceptor arrays 211 and 215 scan a swath 225 on includes the dark signal correction circuit 329, the bright 

object image 104 and a swath 227 on reseau 105 respec- 40 signal conection circuit 331, and the radiometric correction 

lively. The object image backlight 107 illuminates the object circuit 333. The digital object image signals from ADC 319 

image 104, while reseau backlight 109 illuminates the are transmitted first to the dark signal correction circuit 329. 

reseau 105. Illumination of the object image 104 causes light The digital output image signals from dark correction circuit 

waves to propagate through the object 103 (FIG. 1) in 329 are then transmitted to bright signal correction circuit 

proportion to various features in the object image 104 45 331. 

throughout the scan line 221 and through lens 207, which Hie radiometric processing system 327 is used to conect 

focuses the light waves onto photoreceptor array 211, where the known errors or inherent differences in the electronic 

they are detected and transduced to electrical signals. response of each photoreceptor element 212 of photorecep- 

Likewise, illumination of the reseau 105 causes light to tor array 211 to any given incident light intensity. Under 

propagate through reseau 105 along the scan line 223 and 50 ideal conditions, each photoreceptor element 212 would 

through lens 209, which focuses the propagated light onto create an identical signal when under equal illumination 

the photoreceptor array 215. The reseau marks 106 are conditions. In reality, because of slight variations in 

preferably opaque, however, so any light from the reseau materials, manufacturing conditions, and other causes the 

backlight 109 that is incident on a reseau mark 106 would different photoreceptor elements 212 create different output 

not be transmitted through the reseau 105 to the detector 55 signals for the same level of illumination. These errors are 

array 215. Each photoreceptor element 212 in photoreceptor known or can be determined from calibrations performed 

arrays 211 and 215 creates an analog electrical signal that is periodically on the photoreceptor elements 212 and during 

proportional to, and dependent on, the amount of Hght the testing of the scarming apparatus 100. Such calibrations can 

photoreceptor element 212 receives. be accomplished by scanning gray images having known 

The analog object image signals generated by photore- 60 gray values. By storing the measurement of the analog signal 

ceptor 211 are transmitted to CCD support circuit 321, created by each photoreceptor element under various illu- 

whichispartof the data collection subsystem 317. Likewise, mination conditions, such as zero illumination conditions 

the analog reseau signals generated by photoreceptor array and high illumination conditions, radiometric processing 

215 are transmitted to CCD support circuit 323, which is system 327 can interpolate the necessary corrections for all 

also part of the data collection subsystem 317. CCD support 65 other levels of illumination. 

circuits 321 and 323 are used to condition the analog voltage The circuits of radiometric processing system 327 can be 

of the signal created by each photoreceptor element 212. implemented through the use of commercially available 
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digital signal processors, such as Texas Instniments 320C40, 1312c, 1312/, and 1312A: in FIG. 13 are partially coincident 
whose use for this purpose is well known in the art, with reseau mark 106 so their corresponding CCD photo- 
Altematively, since the object image signals are digitized by receptor elements in array 215 (FIG, 2) are currently scan- 
ADC 319 before they are transmitted to the radiometric ning and imaging parts of the reseau mark 106. In other 
processing system 327, a software correction algorithm 5 words, some of the Ught from bottom light 126 (FIG. 1) 
implemented in a standard high-performance microproces- aligned with the image pixels 1312/), 1312c, 1312;', and 
sor can be used. Software solutions to correct the disparities 1312k (FIG. 13) is blocked by the opaque reseau mark 106, 
in photoreceptor elements of photoreceptor arrays are well while the rest of the light ahgned with those image pixels 
known in the art.' 1312^, 1312c, 1312;, and 1312^ is focused on the corre- 

The digital reseau signals are transmitted from ADC 325 sponding CCD elements in array 215 (FIG. 2). Swath image 

(or a combined ADC 319 and 325) to the reseau radiometric pixels niZd, 1312e, 1312/, 1312 1312/i, and 1312t (FIG, 

processing system 337, which is used to correct the digital 13) arc completely coincident with opaque reseau mark 106 

reseau signak and to determine the geometric position of the and no Ught aUgned with those image pixels reaches their 

center of the scanned reseau mark 106. The precision to corresponding CCD photoreceptor elements in array 215 

which the geometric position of the center of the scarmed 15 (FIG. 2). Therefore, those CCD photoreceptor elements in 

reseau mark 106 can be determined is directly related to the array 215 corresponding to pixel images lilld, 1312e, 

precision to which the position of scanner 112 can be 1312/, 1312g, 1312/i, and 1312i (FIG, 13) do not produce 

determined. The principal functional components of the electric signals (other than some base level), and the com- 

reseau radiometric processing system 337, aU of which are putcr utilizes the absence of electric signals from those CCD 

described in more detail below, include the reseau radio- 20 photoreceptors to indicate the presence of the reseau mark 

metric processing circuit 339, the feature isolation circuit 106 at the positions of those image pixels 1312d, 1312e, 

341, the parameter estimator circuit 343, the image trans- 1312/ 1312g, 1312A, and 1312/ (FIG. 13). 

form circuit 346, and the geometric calibration circuit 345. In order to obtain a high level of precision and detail, it 

The digital reseau signals from ADC 325 are transmitted is desirable and useful to determine the position of point P 

first to the reseau radiometric processing circuit 339. The 25 (FIG. 13) where the reseau mark midline 1314 intersects the 

digital signal outputs from the reseau processing circuit 339 image pixel midUne 1316 of scan Une 223. Feature isolation 

are then transmitted to the feature isolation circuit 341. The circuit 341 (FIG. 3) determines the exact center of the reseau 

digital signal outputs from the feature isolation circuit 341 mark 106 being scanned. As discussed above, each CCD 

are transmitted to the parameter estimator circuit 343. The photoreceptor element in array 215 corresponding to each 

digital signal outputs firom the parameter estimator circuit 30 image pixel 1312 in the scan line 223 on the reseau creates 

arc transmitted to the image transform circuit 346, an analog electric signal that is converted into a digital signal 

Reseau radiometric processing circuit 339 performs the by ADC 325. The digital signal represents the gray value of 

same functions for the output signals created by the photo- the image pixel on the reseau 105 being scaimed. Through 

receptor elements 212 scanning Uie reseau 105 as radiomet- the use of a threshold established by cahbration, all image 

ric processing system 327 does for the output signals created 35 pixels that are detected as producing no (or only base level) 

by the photoreceptor elements 212 scanning the object signals below the threshold arc identified as belonging to 

image 104. More specifi^cally, reseau radiometric processing reseau mark 106. In this threshold calibration, all pixels 

circuit 339 corrects for the deviations in the signals gener- having a gray value lower than a predetermined threshold 

ated by the individual photoreceptor elements 212 in scan- gray value indicate image pixels where substantial light, is 

ning the reseau 105 for given incident radiation intensities, 40 transmitted by the reseau 105 and are designated as the 

The digital signal outputs from the reseau radiometric reseau pixels. In FIG. 13, the reseau pixels are currently 

processing circuit 339 are transmitted to the feature isolation bting scanned by the photoreceptor elements corresponding 

circuit 341, which determines which photoreceptor elements image pixels 1312a, 1312/, and the image pixels 1312 

212 are currently scanning reseau marks 106. FIG, 13 is a outside of those two pixels 1312fl and 1312/. All pixels 

planviewof an instantaneous position of a linear array of the 45 having a gray value greater than or equal to the threshold 

image pixels 1312 in a scan line 223 as it sweeps across a gray value are designated as reseau mark pixels. In FIG. 13, 

reseau mark 106, The scan line 223 intersects reseau mark the image pixels 1312£>, 1312c, 1312c/, 1312e, 1312/ 1312^, 

106, and each pixel 1312 on the scan line 223 has a 1312A, 1312i, 1312/ and 1312/: are reseau mark pixels, 

corresponding CCD photoreceptor element in the CCD The reseau mark image pixels 1312b, 1312c, 1312/ and 

photoreceptor array 215 illustrated in FIG. 2 above. With the 50 1312A: vnh have different gray values from each other and 

moveable scan head 101 (FIG. 2) in a position to place the from the reseau mark image pixels 1312c/-1312i, since they 

scan line 223 in the position illustrated, for example, in FIG. are only partially coincident with reseau mark 106, and some 

13, pixels 1312a and 1312/ are not coincident with reseau light from those image pixels reaches the corresponding 

mark 106, so their corresponding photoreceptor elements in CCD photoreceptor elements in anay 215 (FIG. 2). After the 

array 215 (FIG. 2) are not currently detecting reseau mark 55 gray values undergo correction in reseau radiometric pro- 

106. In other words, light from bottom light i) 126 (FIG. 1) cessing subsystem 339 (FIG, 3), as discussed above, the 

passes unimpeded through the reseau 105 in the positions of resulting corrected signals from CCD photoreceptor ele- 

the image pixels 1312a, 1312/, and through other such ments corresponding to image pixels 1312^-1312/ will 

image pixels 1312 in the scan line 223 that are not coincident show nearly identical gray values, because those image 

with the reseau mark 106 (FIG. 13) and is focused by the so pixels are all coincident with the opaque reseau mark 106. 

lens system 209 (FIG. 2) onto the corresponding CCD A Une fitting function is used to determine the position of 

photoreceptor elements in the photoreceptor array 215. reseau mark midline 1314. As shown in FIG. 14, the peak 

Those corresponding photoreceptor elements in array 215 pixel gray values represent the coincidence of the scan Une 

produce electric signals that are indicative of the hght 223 with the reseau mark 106. The conesponding pixel gray 

incident on them, which signals are processed and utilized 65 values are indicated by 1312a'-1312/' and range between 

by the computer system as indicating no reseau mark 106 at zero (0) and 255 if an eight -bits-per-pixel representation is 

those image pixel locations. Scan line image pixels 13126, used. Peak gray values 1312^-1312/' in FIG. 14 result from 
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the low or no electric signals produced by the CCD photo- 
receptor elements in array 215 that correspond to the image 
pixels 1312d-1312i. Using the gray values associated with 
a fixed number of pixels, for example four, an equation can 
be created whose maximum point is approximately the 
location of the position of the rcseau mark midhne 1314 in 
FIG. 13. For example, using four of the pixel gray values 
allows the line fitting equation: 

8~aff*-a^'i-a2y^+a^ (1) 

to be used to approximate the curve 1350 in FIG. 14, where 
g is the grey value and y is the coordinate of individual CCD 
elements within the photoreceptor array. The point 1380 at 
the summit of the curve 1350 in FIG. 14 represents and 
corresponds to the midline 1314 of the reseau mark 106 in 
FIG. 13. Point 1380 can be determined mathematically by 
taking the mathematical derivative of equation (1) which 
provides the maximum value on the curve 1350 in FIG. 14, 
which maximum value occurs at the summit point 1380. 
Therefore, the position of reseau mark midline 1314, in FIG. 
13 can be determined mathematically by a computer from A) 
the gray values of the image pixels 1312i?-1312/: that are 
coincident with the reseau mark 106 as described above. 
Line fitting functions and methods for creating an equation 
representing a series of point values are well known in the 
art. If a line fitting equation like equation (1) is applied with 
more than four pixel gray values, then it is necessary to solve 
an overdetermined system of equations. The problem of 
finding a solution for an overdetermined set of equations is 
well known in the mathematical and photogrammetric arts 
and solutions can be found by many well known methods, 
for example, the method of least squares. 

The output signal of the feature isolation circuit 341 in 
FIG. 3 is transmitted to a parameter estimator circuit 343, 
implemented on the same digital signal processor (DSP) for 
the other circuits or as a separate DSP to increase the 
throughput rate. The parameter estimator circuit 343 uses the 
coordinates of the reseau mark midline 1314 in FIG. 13 
computed by the feature isolation circuit 341 and the posi- 
tion and attitude information as determined by controller 
301 to determine the actual position and attitude of the 
movable scan head 101 (RGS. 1 and 2) for each scan line 
223. The actual position and attitude of the moveable scan 
head, or more specifically, the scaimer 112 and its lenses 
207, 209 and CCD photoreceptor arrays 211, 215, is neces- 
sary to correlate positions of image pixels sensed from the 
object image 104 being scanned with the X-Y coordinate 
system used as the reference for storing, recalling, and 
displaying the pixel images in a composite of the scanned 
object image 104. In other words, when a CCD element 212 
in array 211 in FIG. 2 detects and produces a signal 
indicative of a gray value or color for an image pixel in the 
image scan line 221 of the object image 104, the system 
computer has to know the proper X-Y location to assign that 
gray value or location so that it can be correlated properly 
with other gray values or colors of neighboring image pixels 
for storage, recall, and display of the scanned object image 
104. The actual position and attitude of the a scanner 112 and 
its optical and CCD detector components is a critical link to 
determining those position locations. 

Processing the identified reseau midline pixels for the 
purpose of determining the actual position and attitude of the 
movable scan head 101 can begin when the identified reseau 
midline pixel data from a set of n reseau marks 106 have 
been accumulated within a single photoreceptor line at one 
position of the movable scan head 101 (FIGS. 1 and 2). In 
other words, at each position of the movable scan head 101, 
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the movable scan head 101 is imaging multiple reseau marks 
106. The reseau midline pixel information can be deter- 
mined for each of the reseau marks 106 currently being 
imaged by the movable scan head 101, The processing of the 

5 information determined by identifying the reseau midline 
pixels, which is used to determine the position and attitude 
of the movable scan head 101 for a specific position of the 
movable scan head 101, can begin once the reseau midline 
pixel information for n reseau marks 106 currently being 

10 imaged by the movable scan head 101 has been computed. 
The number n of reseau marks 106 for whose midUne pixel 
information is computed is necessarily less than or equal to 
the total number of reseau marks 106 being imaged by the 
movable scan head 101 at each position of the movable scan 

15 head 101, Data from more than one reseau mark 106 can be 
used, since multiple reseau marks 106 are being scanned 
simultaneously by the scanner 112 for each position of the 
movable scan head 101. In addition, depending on the 
desired geometric accuracy, the reseau mark midline infor- 

20 mation from more than one position of the scan head 101 can 
be used to increase the accuracy by increasing the informa- 
tion known about the position and attitude of the movable 
scan head 101. The number of positions of the movable scan 
head 101 used may vary firom K«l to 51, for example, or 

25 some other appropriate odd number. An odd number of 
movable scan head 101 positions must be used to ensure that 
the additional position and attitude information is based on 
an equal number of additional scan head positions on either 
side of, and parallel to, the current scan head 101 position in 

30 need of a refinement of its position and attitude. 

Each reseau mark 106 being imaged by photoreceptor 
array 215, at each position of scan head 101, has a midhne 
1314, as shown in FIG. 13. As discussed above, the reseau 
mark midline 1314 includes a point P which is a point on 

35 reseau mark midline 1314 that is currentiy being imaged by 
photoreceptor array 215 and represents the intersection of 
reseau mark midline 1314 with image pixel midline 1316. 
The point P on the reseau mark midline 1314 is unaged by 
one, and only one, photoreceptor element 212 of photore- 

40 ceptor 215. As shown in FIG. 13, point P in this example is 
being imaged by photoreceptor element 212 of the photo- 
receptor array 215 corresponding to reseau mark image pixel 
1312 g. As shown in FIG. 16, Point P on the reseau mark 106 
has an associated set of coordinate system values X, Y, Z. 

45 The point P ako has a corresponding point P' on the 
photoreceptor array 215. The point F represents the photo- 
receptor element 212 that is currently imaging the point P. In 
the example shown in FIGS. 13 and 16, point P is being 
imaged by the photoreceptor element 212 in photoreceptor 

50 array 215 that corresponds to reseau mark image pixel 1312 
g- 

As discussed above, for each position of movable scan 
head 101, photoreceptor array 215 images a plurality of 
reseau marks 106. Each individual reseau mark 106 being 

55 imaged by photoreceptor array 215 has a corresponding 
point P that represents the intersection of image pixel 
midline 1316 of scan line 223 with the reseau mark midUne 
1314. The feature isolation circuit 341 determines point P for 
n reseau marks 106 currentiy being imaged by the photore- 

60 ceptor array 215. The number n of reseau marks 106 for 
which point P is determined is necessarily less than or equal 
to the total number of reseau marks 106 currentiy being 
imaged by photoreceptor 215. Each of the points P for the n 
reseau marks 106 has an associated point P on the photo- 

65 receptor 215, as shown in FIG. 16, where 1615 is the plane 
containing photoreceptor array 215. Each image point P* has 
reseau point P with a set of coordinate system values X, Y, 
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Z. In the reseau image, the image coordinates x,y are to the point P' in plane 1615. Z is constant for all of the 

determined by the feature isolation circuit 341 based on the reseau marks 106, since all the reseau marks 106 arc on one 

position of the movable scan head 101 as determined by plane of the glass plate of the reseau 105, and it represents 

controller 301. distance from the point L shown in FIG. 16 on the 

The input to the parameter estimator circuit 343, as shown 5 movable scan head 101 to the plane 1605 containing the 

in FIG. 3, wUl receive the information for locations for point reseau 105. Equations (2) and (3) provide the mathematical 

P' for all l^i^n and all l^j^K identified with a specific relationship between pomt P and point F, mcludmg where 

position of movable scan head 101. With a K value of 51 . y 

positions of the moveable scan head 101 and imaging ten or ^^Pl^^f/^ ^-^^ ^}^k^'^'''^^}^'r' ^u^.^^^ 

^ t ^n/i • * * *i £cnrxnii « whcre the movable scan head 101 IS unmtentionally rotated 

so reseau marks 106, an approxunate toUl of 500 P' loca- lO . . „ . . y . ^ . _ ' . 

Uons will be trai^mitted as mput signals to the parameter ^^^^^^^ ^^^^ ^ ^^^^ unintentionally laterally 

estimator arcuit 343. ..... displaced and unintentionally rotated. 

Parameter estimation mcludes solving for the six following discussion, the X,Y,Z coordinates of the 

unknowns of the movable scan head's 101 posiUon and ^^^^^ consistently used as the reference coordinates, 

attitude. The outcome is denoted as extenor onentation, 15 xhey are found from equations (2) and (3) as appHed to the 

consisting of the three values for position of the scan head pixel coordinates x,y in the digital image, and the elements 

101 on an X, Y, Z orthogonal, three-dimensional coordinate of the inner orientation (x^, y^, c) as well as the elements of 

system (see FIG. 16) and of the three angles of attitude, tip the exterior orientation Qi/, Y/, Z/, r^j, . . . , r^^) as known 

(t})'), roll ((o'), and yaw (a'), as follows: at the time. 

^ r y r 2 20 The rotation of the scanner 112 (FIG. 2) around the X-axis 

115 (roll rotation co), Y-axis 119 (tip rotation ip), or Z-axis 

which are also denoted in the field of photogrammetry as the (y^^ rotation a) creates the rotation elements r.- of a 

"elemenU of the exterior orientation" of one particular rotation matrix R. In general, as is well known in the art, a 

position of the movable scan head 101 (FIGS. 1 and 2). The rotation matrix R provides the mathematical relationship 

index r refers to the sensing subassembly looking at the ^5 between the X, Y, and Z coordinate location of a point on an 

reseau 105, mcluding lens 209 and CCD photoreceptor array object and the new X, Y, and Z coordinate location of the 

215 (FIG. 2). The vanables X^, Y^, and Z^ are the coordi- ^^^^ ^ame object after the object has beeo 

nates of a reference point location L (see FIG. 16), which rotated about X-axis, Y-axis, or Z-axis, or a combination of 

represents the center of the lens 209, which is connected rotations about two or three of the axes. After the rotation of 

structurally to the movable scan head 101. The variable co 30 the object about the X-axis, Y-axis, or Z-axis, the point on 

represents the angle that the movable scan head 101 is ^he object is rotationally displaced from its initial position, 

rotated about the X-axis 115 and can be referred to as the roU ^^^^ ^e designated by X„ Y^, and Z„ to its new 

rotation angle. TTic variable M) represents the angle tiiat the position, which may be designated X^, Y^, and Z^. Tlius, the 

movable scan head 101 is rotated about Y-axis 119 and can rotation matrix R provides the mathematical relationship 

be referred to as the tip rotation angle. The variable a 35 between the coordinates X^, Y„ and Z^ of the point before 

represents the angle that the movable scan head 101 is the rotation of the object and the coordinates X^, Y^, and Z^ 

rotated about the Z-axis 117 and can be referred to as the of the point after the rotation of the object. The mathematical 

yaw rotation angle. relationship, and hence the rotation matrix R, are determined 

The parameter estimation fimction to determine the posi- f,^^ ^he angles of rotation of the object about each of the 

tion and attitude of movable scan head 101 is based on the 40 X-axis, Y-axis, and Z-axis. The rotation matrix R includes 

mathematical tools of a central perspective, as descnbed m .^^^ elements, r^i . . . r^a, arranged as follows: 
modem photogrammetric textbooks, such as Manual of 
Photogrammetry, Fourth Edition, 1980, edited by Chester C. 
Slama, published by the American Society of 

Photogrammetry, Falls Church, Va. The basic premise of 45 
central perspective is a relationship between a point P in the 
plane 1605 of the reseau 105 with coordinates X, Y, and Z, 

and its counterpoint P' with coordinates x, y in the image it is important to recognize that the rotation matrix R is only 

plane 1615, a distance c away from the origin O, as shown concerned with the rotation of the object about tiie X-axis, 

in FIG. 16. The relationship is given by the following 50 Y-axis, or Z-axis. The rotation matrix R does not include 

equations: changes in the coordinates of the point when the object is 

laterally displaced in the X-axis 115 direction, Y-axis 119 

^-^a _ (jc - Xo)rii + (y - yo)rn -H crj^ (2) direction, or Z-axis 117 direction. 

Z-Z^ ix-Xo)r^i +iy-yo)rn'^cr3i During operation of the scanner 112, the movable scan 

V / ^ . / V . 55 head 101 may unintentionally rotate about the X-axis 115 an 

^_2r - (x - jc )r^i ^(^y.y y^^^. cr^^ angle of CO degrees, called roll rotation. The movable scan 

head 101 may also unintentionally rotate about the Y-axis 
119 an angle of degrees, called tip rotation. Furthermore, 

where c is the distance from the center point L of the lens the movable scan head 101 may unintentionally rotate about 

209 to the plane 1615 that contains the CCD photoreceptor 60 the Z-axis an angle of a degrees, called yaw rotation. Each 

array 215 (not shoAvn in FIG. 16) measured along the optical of the unintentional rotations, which may happen 

axis 1618 of the lens 209; x^, y^ are the coordinates of the simultaneously, creates a rotational displacement for each 

point H which is the intersection of the line 1618 with the point on the movable scan head 101, including those points 

plane 1615 that contains the CCD photoreceptor array 215 associated with the photoreceptor arrays 211, 215 and the 

(the tine 1618 is perpendicular to the plane 1615); and X, Y, 65 lens system 209. 

Z are the coordinates of the point P that is on the plane 1605 Therefore, it is customary to describe the rotation of the 

of the reseau 105 (not shown in FIG. 16), which corresponds scanner 112 in the form of a rotation matrix R with nine 
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elements r^^ . . . 133, which in turn are defined by the attitude ^J'Q^fy+^J (14) 

angles co, tl), and a of the movable scan head 101 in the 

reseau system X, Z. More specifically, the rotation ele- <, \ ^> ^ ) 

ments r^y of rotation matrix R are determined by the follow- z '''=(2 0'+^ ' (1^ 

ing equations: 5 

a„'-(a„0'+Aa/ (17) 

^^'-(aoO'+Aa,^ (18) 

aXa^O'+Aa/ (19) 

Linearization of equations (2) and (3) is well known in the 
art and includes substituting the approximations given by 
equations (14)-(19) into the original equations (2) and (3) 
and then taking the Taylor series expansion of the resulting 
equation. All higher order terms are dropped, since they will 
have a negligible effect on the resulting equations. linear- 
ization results in the following two equations: 



rii-cos y^' COB a' 


(5) 




r|2-cos <s/ sin a^'+sin 0'' sin \Jj' cos a*^ 


(6) 




rjj-sin co'^ sin a''-8in ti/ sin cos a*" 


(7) 


10 


r2i-cos Tj)*^ sin a*^ 


(8) 




r22"cos cos a'^-sin a/ sin ii>' sin a*^ 


(9) 




r23=5in to'' cos a''+cos <)f sin li?'' sin a*^ 


(10) 


15 


r3i=5in t^i'^ 


(n) 




r32-sin {y/ cos tp'' 


(12) 




Tjj-cos <i/ cos l^l'' 


(13) 


20 



Y ( XY 



(20) 



For the parameter estimation, it is necessary to compute r ( "^^^ (^^) 

the six unknown values of X/, Y/, Z/, oo^ oT for the " ^ ^ ^ f ^^"T"^^' ^^^^ 
scan head 101 position firom equations (2) and (3). The value 

of c is a fixed spatial relation of the actual distance between 25 

the lens 209 and the photoreceptor array 215, as described the linearized equations, the six unknown variables for 

above and illustrated in FIG. 16. The values Xq and yo are position and attitude of scan head 101 are AX/, AY/, 

determined from cahbrationofthe movable scan head 101. A^o'** ^"1% ^'^''y AX and AY represent differences 

CaUbration is a factory or manufacturer based process between the actual location of a known reseau point P on the 

performed by scanning the reseau marks with precisely 30 reseau plane 1605 and the calculated point P" on the plane 

known values for X/, Y/, Z/, oo'', a'^ and using 1615 as shown in FIG. 17, which diflfercnce results from the 

equations (2) and (3) to solve for c, x^, and y^. Knowledge mathematical method used above. Once AX^'', AY/, AZ/, 

of the precise values used during the calibration is available ^to'', At^j'', and Aa'' have been determined, their values are 

in a precision optical structure that holds a reseau plate and substituted back into equations (14)-(19) above. Equations 

a scan-head in a fixed relationship and moves one with 35 (l^Hl^) are then substituted into equations (20) and (21) 

respect to the other by precisely known distances in the andnewvaluesfor AX/, AY/, AZ/, Acd'', Aa|)^and Aa''are 

X-axis 115 direction, Y-axis 119 direction, and Z-axis 117 computed. This iterative process is continued until the 

direction, and at angles w'*, ojj'', a'*-0. differences in successive values of AX^'', AY/, AZ/, Aco^ 

The solution of six unknown variables X/, Y/, Z/, co'', W> and Aa'' becomes neghgible. 
\|)'*, a' requires a minimum of six equations (2) and (3). Each 40 The parameter estimation process thus far has used con- 
observed point P on the reseau 105 produces two equations, ventional and well known photogrammetric methods, such 
so a minimum of three reseau points P is sufficient to solve ^ those described in the Manual of Photogrammetry. The 
the equations. It is preferable, however, to use more than parameter estimation process described thus far used the 
three reseau points P, so that any errors in detecting a reseau coordinates for a known point P in the plane 1605 of reseau 
mark 106 have less effect. Using more than three reseau 45 1^5. In the present invention, however, the exact X, Y, Z 
points P wiD cause more than six equations to be used to coordinates of P on the reseau mark 106 that correspond to 
solve for the six unknown variables X/, Y/, ZJ, co'', a*" Ihe coordinates of point F on the plane 1615 of the photo- 
of the scan head 101 position, creating an overdetermined receptor array 215 are not known. Instead, only the fact that 
system of equations since there will be more equations than point P lies along the midUne 1314 of a reseau mark 106 
unknown variables. The problem of finding a solution for an 50 scanned by the CCD photoreceptor array 215 and is detected 
overdetermined set of equations is well known in the math- coordinates x,y on the plane 1615 of array 215 is known, 
ematical and photogrammetric arts and solutions can be See FIGS. 2, 13, 16, and 17. As wiU be discussed in more 
found by many well known methods, for example, the detail below, the fact that the precise coordinates X, Y, Z, of 
method of least squares. point P on midline 1314 are not known requires that six 

Equations (2) and (3) are nonlinear, which makes them 55 points P on the reseau mark 106 be used instead of three to 

difBcult to solve. One standard method of deahng with solve equations (2) and (3). 

nonlinear equations is to linearize them by using approxi- There are two sets of parallel reseau marks 106 and they 

mations. The new linear equations are much easier to solve ^ given by the following equations: 
using standard mathematical techniques, for example, the 

method of least squares, and the techniques to do so are weU 60 Y^aX-k-sj?^ (22) 

known in the mathematical and photogrammetric arts. y^-aX^s^bz (23) 

One way to linearize a set of nonlinear equations is to 

make approximations about the unknown variables and then Equations (22) and (23) are standard and conventional 

substitute the linear approximations into the nonlinear equa- equations for straight lines. As best seen in FIG. 4, Sj is the 

tions. For example, the following approximations can be 65 distance between parallel reseau marks 505 extending in one 

made for the variables X/, Z/, to'', ijj'', a*", which define direction in the first set, and s^ is the distance between the 

the position and attitude of scan head 101: parallel reseau marks 507 extending in another direction in 
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the second set. The slope of one of the two sets of parallel 
reseau marks is +a (for example, forty-seven degrees) and -a 
for the second set of parallel reseau marks (for example, 
forty-scven+ninety degrees). It is preferred, but not 
necessary, that the reseau marks 505 in one set be pcrpen- 5 
dicular to the reseau marks 507 in the other set, as shown in 
FIG. 4. The slope +a of a midline 1314 of a reseau mark 106 
is also illustrated in FIG. 17. The variables b^ and bj are 
integers and represent specific reseau marks 106. For 
example, for bj=l there is a specific reseau mark 106, for lo 
bi=2 there is another specific reseau mark 106 and it is 
parallel to the reseau mark corresponding to bi=l. Likewise, 
for bj^l there is a specific reseau mark 106, for b2=2 there 
is a specific reseau mark 106 parallel to the reseau mark 106 
corresponding to b2=l. 15 

The approximate position of the scan head 101 in relation 
to the fixed position of the reseau 105 can be determined 
sufficiently accurately by mechanical or electronic sensors 
or by stepper motor controls, as described above and in U.S. 
Pat. No. 4,149,788, such that for each point P' detected along 20 
the CCD photoreceptor array 215, it is known on which 
reseau mark 106 the corresponding point P is coincident and 
being imaged by the scan line 223. As discussed above, 
however, the exact coordinates X, Y, Z, of point P are not 
known. Referring to FIGS. 16 and 17, projecting the point 25 
P' from the plane 1615 of the CCD photoreceptor array 215 
onto the plane 1605 containing the midline 1314 of the 
reseau mark using standard projection methods creates pro- 
jected point P" on the plane 1605 of the reseau instead of 
point P. P" is determined by using approximate values for the 30 
exterior orientation variables X^'', Y^*", Z/, co'', ip'', a' as 
described above. If the exact values for the exterior orien- 
tation variables X^^ Y/, Z/, w'', i^i'', a'' were used, the 
projected point P" would coincide with point P. 

Equation (22) can be linearized using conventional 35 
numerical techniques and leads to: . 



dY=adX 

As shown in FIG. 17: 

AT'=AY-dY 
aad 

AT'-AY-adX 



(24) 



(25) 



(26) 



(29) 
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There is also a relationship, as shown in FIG. 17, between 
AX and dX, namely: 

AX«=dX (27) 

Therefore, 

AV-AY-OAX (28) 

which, from equations (2), (3), (20), and (21) produces: 



55 



60 



Since there is a relationship between AY' and AX, they are 
not independent variables. The same is true for AX and AY 
Therefore, each point P on the reseau plane 1605 only 
produces one independent variable and only one equation, 65 
since an error AX of a point P affects the point P's distance 
AY from the midline 1314 of the reseau mark by means of 



equation (28). As a result, a minimum of six reseau points P 
are needed, not three as described above for the general 
photogrammetric theory. More reseau points P (fifty for 
example) may be used so that the accuracy of the results is 
improved so long as a naethod is used, for example the least 
squares method, that allows a solution for an ovcrdetcr- 
mincd system of equations. An iterative process similar to 
the one described above is used to solve the system of 
equations. The approximate values for X/ and Y/ are 
known from mechanical or electronic sensors or by stepper 
motor controls. ZJ is a constant since the reseau 105 is flat. 
The angles co'', \|)'', a*" are set to zero (0) for the initial 
iteration. The values for AX/, AY/, AZ/, Ao)^ Atp'', and 
Aa'' are substituted back into equations (14)-(19) above. 
Equations (14)-{19) are then substituted into equations (20) 
and (21) and new values for AX/, AY^'", AZ/, Aco'', Aip'', and 
Aa'' are computed. This iterative process is continued until 
the differences in successive values of AX^**, AY^'', AZ/, 
Aco'', A\l)^ and Aa'' becomes negligible. The system of 
equations is solved for each scan line or for every sixth (for 
example) scan line, depending on the desired accuracy and 
acceptable throughput rate, to determine the attitude and 
position of the movable scan head 101. 

One way to generate approximate starting values for the 
error variables AX/, AY^'', AZ^'', Aco'', Ai^j'', Aa'' used in 
equations (14)-(21) is to have the scanning apparatus 100 
scan an object image 104 having known and preset coordi- 
nates for specific features of the object image 104 a large 
number of times to determine enors that are repeated for 
corresponding positions of the scan head 101 during 
repeated scans of the object image 104. For example, an 
object image 104 can be scarmed one himdred times and 
each scan of the object image 104 wiU produce exterior 
orientation variables X/y Y/, Z/, co'', op'', a'' and corre- 
sponding errors AX^'', AY^*^, AZ^'', Aco'', Aij)'', Aa^ for the 
exterior orientation variables X^'', Y/, Z/, co'', y^"", o!'. The 
portion of the errors AX^'', AY/, AZ/, Aco'', Aijj'', and Aa'' 
that are repeated for each of the scans of the object image 
104 for corresponding positions of the scan head 101 are the 
"repeatable" errors for the scan head 101. The "repeatable" 
errors for the exterior orientation variables X^'', Y/, Z/, co'', 
al)'', a'' of the scan head 101 can be determined in the factory 
and stored in the parameter estimator 343. During use of the 
scanning apparatus 100, the "repeatable" errors can be used 
as starling values for the AX^'', AY^'', AZ^'', Aco'', Atp'', and 
Aa' variables in equations (14)-{21). 

By the calibration means 345 in FIG. 3, the equivalents of 
the values: 

X,', Y/, z/, o'. 

which describe the position and attitude of the lens 209 
looking at the reseau are converted through the image 
transform circuit 346 into the values of the lens 207 looking 
at the object image 104; these position and attitude values 
looking at the object image 104 are denoted as X^*", Y/, ZJ, 
0)'', tj)'', a^ Calibrations and conversions from the exterior 
orientation position coordinates X/, Y^*", ZJ, co'', i|i'', a'' to 
X/, Y/, ZJy co'', li)'', a'' are accomplished by three- 
dimensional translation and rotation, standard photogram- 
metric procedures using matrix arithmetic. These values of 
exterior orientation are then stored in a scan line and 
transform buffer 335 which wiU store up to p image lines 
where p will be between one and several hundreds. 

The circuits of reseau processing system 337 can be 
implemented through the use of cx)mmercially available 
digital signal processors, such as a Texas Instruments 
320 C40. Alternatively, sinc:e the reseau signals are digitized 
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by ADC 325 before they are transmitted to reseau processing Hie information computed by the pixel coordinate gen- 
system 337, a software algorithm implemented in a standard erator 349 is transmitted to the interpolation coefficient 
high-performance microprocessor can be used. circuit 351, The respective output pixel 1503 positions on 
The output signals from the radiometric processing sys- the output swath 1501 of the remaining input pixels 1511 in 
tem 327 (image line pixel data) are combined with the data 5 between every nth pixel is interpolated from the informatioD 
from the reseau processing system 337 (scan line transform computed by the pixel coordinate generator 349 above for 
data) and also stored in the scan line and transform buffer ^^^^ j^put pixel 1511. The smaller the value of n, the 
335. This buffer is a fast, local temporary storage of the ^er the precision and detail of the final output image, 
radiometncaUy corrected object image scan hnes, e.g., interpolation of the output pixel 1503 position is 
twelve bits at a high resolution spacing of five microns, as ^^^^ ^ r t- 
well as the geometric data in the form of "exterior orienta- , ' • r c 
tioD" Of each scan Une. Tlie exterior orientation information . P^^^.f^.^^ 1501 posiUon information for eveiy 
describes the orientation of the movable scan head 101 for "^P^^ P^^^^ ^^^i,^ transmitted from the mtey olation coef- 
each scan hne. In other words, it contains the position (X, Y, ^^^^^ circuit 351 to the rcsamphng circuit 353. Gray value 
Z) and orientation (a, lii, co) of the movable scan head 101 information for each of the input pixels 1511 is also trans- 
as determined while the movable scan head 101 is scanning mitted to the resampling circuit 353 from the scan Unc and 
the reseau 105. The combination of the output signals transform buffer 335. 

defines the image linens geometry. The creation of the output pixel swath 1501 is accom- 

The digital signal outputs from the scan line and trmsform plished by standard image processing methodology as 

buffer 335 arc transmitted to the geometric processing described in handbooks on "Digital Image Processing" 

system 347, which includes the pixel coordinate generator 20 under the headings Image Warping, Image Resampling, or 

349, the interpolation coefficient circuit 351, and the resa- Forward Sampling. In a forward sampling method, the 

mpUog circuit 353. This system 347 converts the input resamphng circuit 353 computes the percentage of the single 

pixels to the desired output pixel swath which would have input pixel that corresponds to the four output pixels 1503 it 

been detected had there been no geometric deviations in the overlaps. For example, in FIG. 15B, input pixel ISlla 

position and attitude of the imaged pixels from an actual, 25 overlaps portions of each of the output pixels 1503a-1503i^. 

^e set of values. The difference between the actual scan xhus, the gray value associated with input pixel 1511^ needs 

^t^^Ti'^''^'''? T to be apportioned among the four output pixels 

AX, AY, AZ, a, ip, and to In an ideal scanning situation X, i503a-1503rf in the same proportion as the geometric areas 

AY, AZ, a, and CO are all equal to zero. In other words, the ^ • * • 1 icn .u * i u * * • 1 

scanner 112 is in exactly the position and orientation that Tia^/^ f each outpu pixe 

controller 301hasdetermineditthatitisin.Inreality, errors ^^?^r^^,f f ^ray value associated with mput pixel 

due to mechanical and other limitations will be introduced wdl also be apporUoned among four output pixels 

so that the scanner 112 deviates in position and orientation mcludmg output pixels lS03b and 1503c. Likewise, 

from the position and orientation that controUer 301 has S^ay value associated with input pixel 151 Ic will be 

determined it to be in. This will be discussed in greater detail apportioned among four output pixels 1503, including out- 

below. Thus position errors will be introduced in the X-axis 35 put pixels 1503fl and 1503rf. When the process is completed 

115 direction, Y-axis 119 direction, and Z-axis 117 direction. for one input scan fine 1515, the process is repeated for the 

In addition, orientation or rotational errors wiU be caused by next successive input scan line and continues until all of the 

rotation of the scanner 112 around the X-axis (roll rotation), input scan lines and swaths are done. 

Y-axis (tip rotation), and Z-axis (yaw rotation). Despite the Resampling circuit 353 keeps track of the sum of the gray 

position and orientation errors, scanning apparatus 100 40 values apportioned from input pixels 1511 to each output 

accordingly to this invention will create an output image that pixel 1503 and will not let an output pixel 1503 gel a total 

corresponds to the input image that would have been computed gray value that exceeds the maximum possible 

detected had the position and orientation errors not existed. actual value. Recalibration of all of the output pixels 1503 

In FIG. 15A, the grid 1501 is the desired output array of may be necessary in order to ensure that a single output pixel 

pixels 1503. Had there been no geometric deviations 45 1503 does not exceed the maximum allowable gray value, 

between the position and attitude of the movable scan head The interpolated signals from the resampling circuit 353 

101 in its actual position and the position and attitude of the are stored and formatted in an optional swath buffer and 

movable scan head 101 as determined by the controller 301, multiswalh formatter 355. This constitutes a memory and 

the pixels 1511 in the input scan line 1515 would be programmed processor, preferably separate and independent 

perfectly aligned with the pixels 1503 in the output array so from the scanner, viz., on a user host computer system where 

1501. The geometric deviations are created when AX, AY, the desired user's image formats are created. Since there are 

AZ, a, ip, and CO are not all equal to zero. Therefore, as many different formats (pixel, line, or sequential for color, 

shown in FIG. 15B, each pixel 1511 in input scan line 1515 TIFF, TOA, COT, GIF, DIF, etc.), the task of creating a 

covers portions of four pixels 1503fl-1503d on the desired deliverable output image format is best handled indepen- 

output array 1501. Had there been no position or orientation 55 dently from the scanning process. 

errors, each pixel 1511 on the input scan Hne 1515 would Optionally, however, a separate scanner reformatting ele- 

completely cover one pixel 1503 on the output array 1501. ment 355 can be meaningful if the scanner is operated in a 

The signal from the scan line and transform buffer 335 stand-alone configuration with on-line data transfer to a 

transmitted to the pixel coordinate generator 349 contains user's host computer system. 

the six position (X, Y, Z) and orientation (a,ap,a)) values 60 A scanner interface 359 receives scanner command sig- 

corresponding to the input scan line 1515. The pixel coor- nals bom a host machine and transmits the scanned pixel 

dinate generator 349 then computes the input pixel's posi- information. The scanner interface 359 is also coupled to the 

tion on the output swath 1501 and which four output pixels CCD controller 301. 

ISaSa-d the input pixel 1511 overiaps. It accomplishes this Some of the elements of the system shown in FIG. 3 can 

computation by using the exterior orientation values AX, 65 be incorporated into a microprocessor controller. For 

AY, AZ, a, t]), and to for each nth pixel 1511 of input scan example, the geometric processing system 347, the reseau 

Une 1515. processing system 337, the radiometric processing system 
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327, the scan line and transform buffer 335, the controller 
301, the scanner interface 359, and the swath buffer and 
multiswath formatter 355, or any combination of these 
elements may be programmed into one or more commer- 
cially available microprocessors. 

In order to understand more completely the errors created 
by lateral and rotational displacement of the scan head 101 
of the scanner 112, it is helpful to refer to FIGS. 5 A, 5B, 7 A, 
and 7B. As discussed above, as the scan head 101 with the 
scanner 112 is moved in the X-axis 115 direction and the 
Y-axis 119 direction, its approximate position is calculated 
by controller 301 from inputs from stepper motor controls, 
electronic position sensors or other suitable position sensors, 
as described above. Due to mechanical limitations inherent 
to the movable components of scanning apparatus 100, 
errors are introduced that cause the true position of scanner 
112 to deviate from the position calculated by controller 301. 
Such positional errors can create errors in the positional and 
compositional results of scanned object image 104, if they 
are not corrected. For example, the controller for scanner 
112 might indicate that a certain pixel scanned on object 
image 104 is in one position on object image 104, when in 
fact it is in a different position on object image 104. Such 
errors can be created in both the X-axis 115 ID direction and 
the Y-axis 119 direction. Again, such errors are caused by 
many factors, including loose mechanical tolerance in drive 
or mounting mechanisms that allow small amounts of unin- 
tentional rotation of scan head 101 and/or scanner 112 about 
the X-axis (referred to as roll rotation d), unintentional 
rotation of scanner 112 about the Y-axis (referred to as tip 
rotation At), and unintentional rotation of scanner 112 about 
the Z-axis (referred to as yaw rotation a). In addition, the 
errors can be created by loose tolerance in mechanical drives 
or in electrical sensors that allow imprecise or incorrect 
positioning of scan head 101 and/or scanner 112 in the 
X-axis 115 direction, Y-axis 119 direction, or Z-axis 117 
direction. It is necessary, therefore, to calculate corrections 
to the positional and attitude information created by con- 
troller 301 so that the conections can be made to the scanned 
object image 104. 

As the fixed and immovable object image 104 and resean 
105 are scanned, therefore, the actual position and attitude of 
scanner 112 is determined relative to them. As discussed 
above, the difference between the position and attitude as 
determined by controller 301 and as determined by scanning 
the reseau 105 and measuring the scanner 112 true position 
in relation to the reseau marks 106 is used to determine the 
exact position of the pixels on object image 104. 

FIG. 5A and FIG. 5B iQustrate some of the positional 
eaors discussed above. In FIGS. 5Aand 5B, NW/SE reseau 
marks 106 are indicated by 505fl-505c, and SWINE reseau 
marks 106 are indicated by 507a-507£), Controller 301 (not 
shown in FIG. 5A or FIG. 5B) has scan line 223 (FIG. 2) 
oriented relative to reseau 105 and reseau marks 106 as it 
theoretically should be in position 501. In reality, however, 
due to the errors introduced by the inherent mechanical 
hmitations and tolerances of the moving components of 
scanning apparatus 100 and scanner 112 mounted therein, 
the actual orientation of scan Une 223 relative to reseau 105 
and reseau marks 106 is not position 501. FIG. 5A illustrates 
the enors that occur when the movable scan head 101 is 
unintentionally displaced laterally along the X-axis 115 
direction or Y-axis 119 direction or both, FIG. 5B illustrates 
the errors that occur when the movable scan head 101 is 
unintentionally rotated around the Z-axis 117. 

As shown in FIG. 5A, enors in both the X-axis 115 
direction and the Y-axis 119 direction are created by the 
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deviation of the actual scan line position 503 from the 
theoretical scan line position 501. The error along the X-axis 
115 is AX while the error along the Y-axis 119 is AY. It is 
also possible to have errors along the Z-axis 117. Errors 

5 along the Z-axis 117 constitute the difference between what 
controller 301 has determined the distance between reseau 
105 and photoreceptor array 215 to be and what the distance 
between reseau 105 and photoreceptor array 215 actually is. 
The error along the Z-axis 117 is manifested as a change in 

10 magnification of the scanned object image 104. When the 
situation illtistrated in FIG. 5A occurs, the actual scan line 
position 503 is laterally displaced along the X-axis 115 and 
the Y-axis 119, but not rotationaUy displaced about the 
Z-axis 117, fi-om theoretical position 501. 

15 FIG. 5B illitstrates the situation when the actual scan line 
position 503 is rotationaUy displaced about the Z-axis 117 
(yaw rotation a), but not laterally displaced along the X-axis 
115 or Y-axis 119. In FIG. 5B, scan line 223, as theoretically 
oriented in position 501, intersects the SW/NE reseau marks 

20 507a-5076 and the NW/SE reseau marks 505fl-505c. The 
distance between the intersections of this theoretical position 
501 and the SW/NE reseau marks 507^-5076 is shown as 
Uq, while the distance between the intersections of this 
theoretical position 501 and the NW/SE reseau marks 

25 505a-505c is denoted as Vq. The values for Uq and Vq would 
be preset by the user or manufacturer during creation and 
manufacture of the reseau 105. Scan hne 223, as actually 
oriented in position 503, also intersects the SW/NE reseau 
marks 507a-5076 and the NW/SE reseau marks 505fl-505c. 

30 The distance between the intersections of this actual position 
503 and the SW/NE reseau marks 507a-507fe is shown as U, 
while the distance between the intersections of this actual 
position 503 and the NWISE reseau marks 505fl-505c is 
denoted as V. 

35 As shown in FIG. 5B, the rotation of scanner 112, and 
hence the rotation of the movable scan head 101, about the 
Z-axis (the yaw rotation) creates an angle a between scan 
line 223 in the theoretical position 501 and scan line 223 in 
the actual position 503. This rotation creates an error AX' in 

40 the X-axis 115 direction and an error AY' in the Y-axis 119 
direction. 

The errors illustrated in FIG. 5Aand FIG. 5B can happen 
simultaneously. That is, the movable scan 101 can be 
laterally displaced along the X-axis 115 or Y-axis 119 and 

45 simultaneously rotationaUy displaced about the Z-axis 117 
(yaw rotation). In addition, lateral displacement along the 
Z-axis 117 and/or rotational displacement about the X-axis 
115 (roll rotation) or Y-axis 119 (tip rotation) may also occur. 
Therefore, a rigorous and simultaneous correction of all 

50 lateral and rotational displacement errors is necessary and 
the method for doing so is provided in the discussion 
accompanying equations (2)-(29). 

FIGS. 7A and 7B illustrate that rotation of scanner 112 
and scan head 101 about the Y-axis 119 (referred to as tip 

55 rotation tp) also creates an error in the X-axis 115 direction. 
In FIG. 7A, the end of the CCD photoreceptor array 215 
above the Teseau 105 is shown in diagrammatic elevational 
view wherein reseau 105 is in the plane 1605 perpendicular 
to the plane of the paper containing FIG. 7A, and the Y-axis 

60 119 direction is also perpendicular to the plane of the paper 
containing FIG. 7 A In the ideal condition, photoreceptor 
array 215 is in exactly the position controller 301 (FIG. 3) 
believes it to be in. Therefore, light ray 701 (or the absence 
of a hght ray, if a reseau mark 106 is present) in this ideal 

65 condition passes through a pixel 715 reseau 105 and then 
through lens 209 in the Z-axis 117 direction perpendicular to 
the plane 1605 of the reseau 105 to the CCD photoreceptor 
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array 215 where it is detected. If, however, scanner 112 is 
slightly rotated about a Y-axis 119 an angle of ij) degrees (the 
tip angle) due to loose mechanical tolerance, as described 
above, photoreceptor array 215 will actually be slightly 
displaced into an ofiEset position indicated by 215', as illns- 
trated in FIG. 7A, and lens 209 will be slightly rotated into 
position 209'. Likewise, light ray 701 will be sUghtly dis- 
placed into position 701'. The arrows 115, 117, 119 of the X, 
Y, Z coordinate system illustrated in FIG. 7A are for the 
purpose of showing directional orientation the same ais the 
orientation of FIGS. 1 and 2. Therefore, reference to rotation 
of the scanner 112 about a Y-axis extending in the Y-axis 119 
direction refers to an axis of rotation that extends through, 
for example, the lens 209, not necessarily coincident with 
the Y-axis arrow 119 in the coordinate system indicator in 
FIG. 7A. Also, the diagrammatic rotation or tip angle i|j is 
exaggerated in FIG. 7A over what would actually be 
expected for purposes of clarity. If controller 301 is not 
aware of the rotation, an error, called the tip error, is created 
along the X-axis and is denoted by AX in FIG. 7A. Instead 
of light ray 701 emanating through the pixel 715 plane 1605 
of reseau 105 being detected by CCD photoreceptor array 
215 for the position of the photoreceptor anay 215 that 
controller 301 has determined it to be in, a different light ray 
701 passing through a dififerent pixel 715' on plane 1605 of 
reseau 105 is detected. This error would create inaccurate 
pixel information for the pixel 715' on reseau 105, because 
the controller 301 would have determined that pixel 715 was 
being scanned. Consequently, it is important to be able to 
distinguish between a AX error created by the tip angle vj), 
and the AX and AX' errors illustrated in FIGS. 5A and 5B 
and discussed above, since different correction methods are 
used for each type of error. More specifically, the correction 
factor used for the error created by the tip angle ij) is applied 
in the opposite direction in the object image from the 
correction factor used for AX and AX* errors illustrated in 
FIGS. 5 A and 5B. In other words, if an error caused by the 
tip angle is incorrectly determined to be caused by the AX 
and AX' errors illustrated in FIGS. 5A and 5B, the correction 
factor for the scan head 101 in the X-axis U5 direction 
would be applied in the wrong direction. 

It is possible to detect the tip error AX of FIG. 7A 
independently of the other AX and AX' error of FIGS. 5A 
and 5B by modifying scanner 112, as illustrated in FIG. 7B. 
In this embodiment, in addition to CCD photoreceptor array 
215 and lens 209, a second CCD photoreceptor array 723 
and a separate lens 709 are used to scan reseau 105 simul- 
taneotis with the scan by CCD photoreceptor array 215 and 
lens 209. This second CCD photoreceptor array 723 and 
second lens 709 are also mounted in scanner 112, with 
second CCD photoreceptor 723 being parallel to the first 
CCD photoreceptor array 215. However, the second CCD 
photoreceptor 723 is positioned so that it would scan a pixel 
725 that is Tq distance away in the X-axis 115 direction from 
the pixel 715 that woidd be scanned by photoreceptor array 
215, if there was no tip rotation, as described above. In such 
ideal condition, the first CCD photoreceptor array 215 and 
the second CCD photoreceptor array 723 would be in 
exactly the positions that controller 301 believes them to be 
in. Therefore, in the ideal condition, light ray 701 would pass 
through a pixel 715 in the plane 1605 of reseau 105 and then 
through lens 209 to where it is detected by the first CCD 
photoreceptor array 215. The ray 701 can, but does not have 
to, be perpendicular to plane 1605 of reseau 105, as illus- 
trated in FIG. 7B..At the same time, another light ray 705 
passes through a pixel 725 in the plane 1605 of reseau 105 
and then linearly through lens 709 to where it is detected by 
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the second CCD photoreceptor 723. If, however, scanner 
112 is rotated about a Y-axis an angle of ij) degrees (the tip 
angle), the first CCD photoreceptor array 215 will be dis- 
placed into the position indicated by 215*. Lens 209 will be 

5 displaced into position 209'. In addition, the second CCD 
photoreceptor array 723 will be displaced into position 723', 
and lens 709 will be displaced into position 709*. Light ray 
701' from pixel 715' instead of light ray 701 from pixel 715, 
will be detected by the first CCD detector array 215 in the 

10 displaced position 215' and light ray 705' from pixel 725' 
instead of light ray 705 from pixel 725. These displacements 
will cause the measured distance in the X-axis 115 direction 
between the pixel 715' and 725' detected from respective 
light rays 701' and 705' to become r instead of the rQ distance 

15 between the pixel 715 and 725. The tip angle \1) can be 
determined from the value of r, since each possible value of 
r has a corresponding tip angle op. Also, if r in FIG. 7B has 
a value that is larger than ro, scarmer 112 rotation about a 
Y-axis is counterclockwise. If r has a value that is less than 

20 ro, scanner 112 rotation about a Y-axis is clockwise. 

An implementation of a dual (or even triple) line reseau 
imaging element to provide the tip rotation detection ability 
described above incorporates the use of a single element line 
array with two (or three) lens systems, as illustrated in FIG. 

25 lOA and lOB. In FIG. lOA, a single photoreceptor array 
1001 is used and includes three noncontiguous photorecep- 
tor segments, 1001 A, lOOlB, and lOOlC in the reseau plane. 
The photoreceptor anay 1001 might comprise, for example, 
6,000 (CCD) photoreceptor elements with segments 1001 A, 

30 lOOlB, and lOOlC having 2,000 CCD photoreceptor ele- 
ments each. Photoreceptor array lOOlB is positioned 
between opaque shield 1015 and opaque shield 1017. 

There are three separate lenses, 1005, 1007 and 1009, 
which focus the reseau image onto photoreceptor segments 

35 lOOlA, lOOlB, and lOOlC respectively Lens 1007 is posi- 
tioned to focus the reseau 105 image onto photoreceptor 
segment lOOlB. As shown in FIG. lOB, photoreceptor 
segments lOOlA, lOOlB, and 1001 C are contiguous and lie 
in the same plane. Likewise, lenses 1005, 1007, and 1009 lie 

40 in the same plane. 

Opaque shield 1017 (not shown in FIG. lOB) is perpen- 
dicular to the plane containing photoreceptor array 1001 and 
is positioned such that fight rays passing through lens 1007 
are not detected by photoreceptor segment 1001 A, and light 

45 rays passing through lens 1009 are not detected by photo- 
receptor segment lOOlB. Similarly, opaque shield 1015 (not 
shown in FIG. lOB) is perpendicular to the plane containing 
photoreceptor array 1001 and is positioned such that light 
rays passing through lens 1007 are not detected by photo - 

50 receptor segment lOOlC, and light rays passing through lens 
1005 are not detected by photoreceptor segment lOOlB. 
Neither opaque shield 1015 nor opaque shield 1017 are in 
direct contact with photoreceptor array 1001. 
Photoreceptor array 1001, lenses 1005, 1007, and 1009, 

55 and opaque shields 1015 and 1017 are rigidly and immov- 
ably fixed in relation to each other by an optical head frame 
(not shown) similar to those described above. 

The lens system shown in FIGS. lOAand lOB operates in 
a manner similar to that of the lens system discussed above 

60 and shown in FIGS. 7A and 7B to detect rotation of the 
scanner 112 around a Y-axis (tip rotation). That is, any 
rotation of the lens system around a Y-axis (tip rotation) will 
create measurable displacement error r, which corresponds 
to a particular tip angle ijj. See FIG, 7B and related discus- 
es sion above. In operation, the three lenses 1005, 1007, and 
1009 focus the reseau image onto photoreceptor segments 
lOOlC, lOOlB, and lOOlA respectively. Like photoreceptor 
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arrays 211 and 215 discussed above, each CCD photorecep- 
tor element in photoreceptor array 1001 generates an electric 
signal in proportion to the amount of light detected by the 
CCD photoreceptor element. The signals generated are 
analyzed and processed in the same manner as that discussed 
above. 

Another preferred embodiment of the present invention 
that detects rotation around a Y-axis (tip rotation) is shown 
in FIG. IOC. Photoreceptor segments lOOlD and lOOlE lie 
in the same plane 1072 above lens 1057. Reseau 105 hes in 
a plane 1605 below lens 1057. The lens 1057 and photore- 
ceptor segments lOOlD and lOOlE are held by a scanner 
frame (not shown in FIG. IOC, but similar to the scanner 112 
in FIG. 2) in a rigid, fixed, relationship with each other. The 
system shown in FIG. IOC operates in a similar fashion to 
the system shown in FIG. 7B and described above. In normal 
operation, there is a distance r between the swath 1023 
scanned by photoreceptor segment lOOlE and the swath 
1024 scanned by photoreceptor lOOlD. Rotation of the 
scanner 112 about a Y-axis (tip rotation) will cause displace- 
ment of the swaths 1023 and 1024, thus causing a measur- 
able change in the distance r with corresponds to a specific 
tip angle \^ of rotation about the Y-axis. The signal process- 
ing is done in a similar manner as that described above. 

This embodiment in FIG. IOC has several advantages 
over the previous embodiment shown in FIG. 10 B. 
Primarily, since it requires fewer components, the cost, the 
complexity, and the size of the scanning apparatus is 
reduced. 

It should be noted that a problem similar to the problem 
discussed above for AX errors caused by lateral displace- 
ment and of the scan head 101 along the X-axis 115 and 
rotational displacement of the scan bead 101 about the 
Y-axis 119 also exists for AY errors. The AY errors can be 
caused by rotational displacement of the scan head 101 
about the X-axis 115 (referred to as roll rotation (a) and 
lateral displacement of the scan head 101 along the Y-axis 
119. As previously discussed above for AX errors, it is 
important to be able to distinguish between a AY error 
created by the roll rotation to of the scan head 101 about the 
X-axis 115 and lateral displacement of the scan head 101 
along the Y-axis 119. The problem can be solved by, for 
example, adding additional photoreceptor segments lOOlF, 
lOOlG to the photoreceptor segments lOOlD, lOOlE shown 
in FIG. IOC to obtain the lens system shown in FIG. lOD. 
The photoreceptor segments lOOlF, 10010 and the scan lines 
1025, 1026 work in a similar fashion to the photoreceptor 
segments lOOlD, lOOlE and the scan lines 1023, 1024 
described above. Alternatively, the photoreceptor segments 
lOOlD, lOOlE can be oriented (not shown) so that they are 
able to detect both tip rotation vp and roll rotation co of the 
scan head 101. Other lens configurations are also possible 
that can detect both tip rotation 1^1 and roll rotation co of the 
scan head 101. 

An alternative embodiment for mounting the reseau 105 
out of the optic path of the object iroage 104 scanner is 
illustrated diagrammatically in FIG. 6. A frame 601 rigidly 
holds the object 103, which contains the object image 104 
and the reseau 105, which further contains the reseau maiks 
106, in a fixed and immovable spatial relationship to each 
other, preferably in the same plane for this embodiment. 
Scanner carrier 607 includes optics system 609 and optics 
system 611. Optics system 611 includes lens 207 and pho- 
toreceptor array 211 and is similar in design to the optical 
systems described above for FIG. 2. Likewise, optics system 
609 includes lens 209 and photoreceptor array 215. Scanner 
carrier 607 holds optics system 611 in a fixed position in 
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relation to optics system 609. Optics system 611 scans object 
image 104 while optics system 609 simultaneously scans 
reseau 105 in manner similar to that described above for 
FIGS. 1 and 2. The signal processing and error correction are 

5 done in a manner similar to that discussed above. 

Another embodiment of the present invention that will 
prevent the image of the reseau marks 106 from overlaying 
the scanned object image 104 is illustrated in FIG. 8. A 
movable frame 801 includes a linear photoreceptor 803 and 

10 a lens system 805. Movable frame 801 is moved in the 
Y-axis 119 direction by a computer controlled stepper motor 
811 \ising a threaded rod 812 bearing nut 813 and in the 
X-axis 115 direction by a computer controlled stepper motor 
809 using a threaded rod 810 and bearing nut 814. Motor 

15 809 and threaded rod 810 are mounted on a part 802 of 
movable frame 801. The lens system 805 focuses a scan line 
815 from an imaging plane 807 as movable frame 801 is 
controlled and moved by a scan control 823. Scan control 
823 controls and operates the motor 811 via a cable 819, and 

20 it operates the motor 809 via a cable 821. Example bearing 
and drive mechanisms for moving the moveable frame 801 
in the X-axis 115 direction and for moving the movable 
frame 801 in the Y-axis 119 direction can include worm gear 
and follower components driven by stepper motors similar 

25 to those shown and described above for FIGS. 1 and 2 and 
those in U.S. Pat. No. 4,928,169, which is incorporated 
herein by reference, or by any other suitable mechanisms 
and components. 
Signals from the photoreceptor array 803 are transmitted 

30 to a signal processor 825 by a cable 817. The signal 
processor 803 conditions the signals, correcting for the 
effects and errors of the position of movable frame 801 as 
previously described for FIGS. 1, 2, 3, 4, 5, and 7. The 
conditioned signals are transmitted to a switch 827 and then 

35 transmitted to either reseau processor 829 or image proces- 
sor 833, depending on whether the reseau 105 or the object 
image 104 respectively is being scanned. 

Initially, a reseau 105 is placed in the image plane 807, 
and the switch 827 is positioned to allow transmission of the 

40 signals from the photoreceptor 803 to a reseau processor 
829. The reseau 105 is then scanned, as described above, and 
information regarding the actual position of movable frame 
801 in relation to the reseau 105 is transmitted to reseau 
processor 829. Reseau processor 829 also receives position 

45 signals from scan control 823 that contain information 
regarding the position of movable frame 801, as calculated 
by scan control 823. This information enables reseau pro- 
cessor 829 to determine the deviation between the actual 
position of movable frame 801 and the position of movable 

50 frame 801 that has been determined by scan control 823, The 
reseau processor 829 then computes and stores a map of 
positional errors of the movable frame 801 in reseau 
memory 831. The map of positional errors of the movable 
frame 801 contains the repeatable (thus systematic) errors of 

55 the movable frame 801 which will be used when an object 
103 is placed in the scanning plane 807 and replaces the 
reseau 105. The map of positional errors does not, however, 
contain the random (non-repeatable) errors that occur during 
movement of the movable frame 801. 

60 After the reseau 105 has been scanned, the reseau 105 is 
removed and an object 103 is placed in the scanning plane 
807. The switch 827 is positioned to allow the transmission 
of the signals from the signal processor 825 to an image 
processor 833. The object image 104 on the object 103 is 

65 then scanned as described above and information regarding 
the actual position of movable frame 801 is transmitted to 
image processor 833. Image processor 833 also receives 



11/28/2003, EAST Version: 1.4,1 



us 6,288, 

31 

position signals from scan control 823 that contain infor- 
mation regarding the position of movable frame 801 as 
calculated by scan control 823. In addition, image processor 
833 retrieves the positional error signals created from the 
prior scan of the reseau from the reseau memory 831. The 5 
positional error signals are used to correct the positional 
signals generated by scan control 823 to ensure that the 
object image is accurately scanned. The correction methods 
used are similar to those described above and arc well 
known in the art. lo 

Ihe corrected image pixel information is then stored in an 
image memory 835 which can be used by a utiUzation device 
such as a display system 837 for measurements, viewing, 
and other applications. 

The reseau 105 and object image 104 are considered to be 15 
imaged sufi&cicntly close in time such that error sources 
which may change with time, e.g., ambient temperature, can 
be considered constant. Thus, the corrections normally sup- 
plied simultaneously with the scanning of the object image 
104 as described above in relation to FIGS. 1, 2, and 3 arc 20 
simulated by scanning the reseau 105 separately and storing 
the results, which are then used for scanning the object 
image 104. 

Another embodiment employs the reseau image to com- 
pute corrections to the object image and stores those cor- 25 
rections as a calibration table. Any subsequent object images 
are then corrected using the values contained in the calibra- 
tion table. Such corrections represent the repeatable (thus 
systematic) errors of the scan head geometry, but ignores the 
random errors which do not repeat. 30 

In another embodiment 1112 of the scanner of this inven- 
tion is shown diagrammatically in FIG. IIA, wherein the 
physical dimensions of scanner 1112 are reduced by folding 
the optics. This reduction in size is accomplished by cou- 
pUng the optical system that scans the reseau 1105 and the 35 
optical system that scans object image 1104. In addition, 
mirrors 1141, 1143, and 1145 are used to alter the optical 
paths of the Ught rays detected by the object image photo- 
receptor array 1111 and by the reseau photoreceptor array 
1115 such that the over-all dimensions of scanner 1112 are 40 
reduced. In Uiis embodiment 1112, only a single lens 1109 is 
used. 

Object image backlight 1117 illuminates the object image 

1104, while reseau backlight 1119 illuminates the reseau 

1105. Alternatively, object image 1104 can be illuminated by 45 
object image frontUght U18. 

The frame and the supporting structure for the lens 1109, 
mirrors 1141, 1143 and 1145, and photoreceptor arrays 1115 
and 1111 are not shown in the diagrammatic view of FIG. 
IIA. The methods and materials for constructing a frame 50 
and optical supporting structure for this embodiment of 
scanner 1112 are within the capabiUties of persons skilled in 
the art once the principles of this invention and the structures 
described above are understood or known. In diagrammatic 
FIG. IIA, the object image 1104 and reseau 1105 are 55 
considered to be fixed in a rigid position by such a frame (not 
shown). Likewise, lens 1109, mirrors 1141, 1143, and 1145, 
and photoreceptor arrays 1111 and 1115 are considered to be 
rigidly fixed within the frame. 

Mirror 1145 is positioned such that light rays emanating 60 
from reseau backlight 1119 and passing through reseau 1105 
reflect off mirror 1145 in such a direction that they pass 
through lens 1109 and then are detected by photoreceptor 
array 1115. Light rays that strike mirror 1145 which do not 
emanate from reseau backlight 1119 are oot reflected 65 
through lens 1109 and arc not detected by photoreceptor 
array 1115. 
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Mirrors 1141 and 1143 are positioned such that light rays 
emanating from object image backlight 1117, or object 
image frontlight 1118 passing through or reflecting from 
object image 1104, reflect off mirror 1141 in such a direction 
that they also pass through lens 1109 and reflect off mirror 
1143 and then are detected by photoreceptor an-ay 1111. 
Light rays that strike mirror 1141 or mirror 1143 which did 
not emanate from object image backlight 1117 or object 
image fi-ontlight 1U8 are not reflected through lens 1109 and 
they are not detected by photoreceptor array 1111. 

Diaphragm 1166 completely blocks some of the Hght rays 
emanating from reseau backlight 1119 and passing through 
reseau 1105. More specifically, some of the light rays 
emanating from backlight 1119 and passing through reseau 
1105 could, upon reflecting off mirror 1145 and passing 
through lens 1109, be further reflected off of mirror 1143 and 
detected by photoreceptor array 1111 instead of being 
detected by photoreceptor array 1115. Diaphragm 1166 
blocks those light rays emanating from reseau backlight 
1119 that would otherwise strike mirror 1143 and be 
detected by photoreceptor array 1111 if they were allowed to 
propagate. Therefore, all of the light rays emanating from 
reseau backlight 1119 and passing through reseau 1105 and 
diaphragm 1166 reflect off of mirror 1145, pass through lens 
1109, and are detected by photoreceptor array 1115. Dia- 
phragm 1166 also ensures that extraneous or spurious light 
rays that might otherwise strike mirror U43 or pass through 
lens 1109 are not allowed to propagate into scanner 1112. 
Using the two photoreceptor segments 1115a and 11156 to 
comprise photoreceptor array 1115 provides for the detec- 
tion of scanner 1112 rotation as described above in relation 
to FIGS. 7B, lOA, lOB, and IOC. 

In a similar manner to diaphragm 1166, diaphragm 1168 
completely blocks some of the light rays emanating from 
object image backlight 1117 and passing through object 
image 1104. This ensures that only light rays emanating 
from object image backlight 1117 and passing through 
object image 1104 that will strike mirror 1141 are aUowed to 
propagate into scanner 1112 and that extraneous or spurious 
Hght rays that might otherwise strike mirror 1143 or pass 
through lens 1109 are not allowed to propagate into scanner 

m2. 

Like photoreceptor arrays 211 and 215 discussed above, 
each photoreceptor element 212 in photoreceptor array 1111 
and photoreceptor array 1115 generates an electric signal in 
proportion to the amount of light detected by the photore- 
ceptor element 212. The signals generated are analyzed and 
processed in a similar manner as that discussed above. 

In the embodiment 1112 of the scanner of this invention 
shown diagrammatically in FIG. IIA, wherein the physical 
dimensions of scanner 1112 are reduced by folding the 
optics, it is desirable and preferred to have the angle 7 
formed between the photoreceptor segments 1115fl, 1115fe 
and the lens 1109 be as large as possible in order to better 
distinguish between errors caused by lateral displacement of 
the scan head 101 and rotational displacement of the scan 
head 101. Preferably, the angle y is greater than forty-five 
degrees and is optimally approximately ninety degrees. The 
angle y can be enlarged, as shown in FIG. 11 B, by including 
a second lens 1170 and an additional reseau backflght 1172 
to illuminate the reseau 1105, and by changing the dia- 
phragm 1166 to the diaphragm 1173 to reduce the light 
emanating from the reseau backlight 1119 that passes 
through the reseau 1105 and reflects off of the mirror 1145. 
The reseau backlight 1119 can also be shortened, as shown 
in FIG. UB. 

In this embodiment, the mirror 1145 is positioned such 
that light rays emanating from reseau backlight 1119 and 
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passing through the rescau 1105 reflect off the mirror 1145 
in such a direction that they pass through the lens 1109 and 
then are detected by photoreceptor array 1115a. Light rays 
that strike the mirror 1145 which do not emanate from the 
reseau backlight 1119 are not reflected through the lens 1109 
and arc not detected by the photoreceptor array 1115a. In 
addition, light rays emanating firom the reseau backlight 
1172 pass through the lens 1170 and are detected by the 
photoreceptor array 1115^?. In a similar manner to the 
diaphragm 1166 discussed above, the diaphragm 1173 com- 
pletely blocks some of the hght rays emanating from the 
reseau backlight 1119 and passing through the reseau 1105. 
Likewise, the diaphragm 1174 completely blocks some of 
the light rays emanating from the reseau backlight 1172 and 
passing through the reseau 1105. Wiih the addition of the 
lens 1170, the angle y shown in FIG. IIB is now consider- 
ably larger than the angle y shown in FIG. IIA. 

In another embodiment of scanner 1212 shown diagram- 
matically in FIG. 12, the physical dimensions of scanner 
1212 arc reduced by coupling the optical system scanning 
reseau 1205 and the optical system scanning object image 
1204. In addition, mirrors 1241, 1243, 1245, 1251, 1253, 
and 1255 are used to alter the optical paths of the light rays 
detected by object image photoreceptor array 1211 and 
reseau photoreceptor array 1215 such that the dimensions of 
scanner 1212 are reduced. In this embodiment, only a single 
lens 1209 is used. It is possible, however, to include other 
lenses (not shown) to increase the angle y, as previously 
discussed and as shown in FIG. IIB. 

Object image backlight 1217 illuminates the object image 

1204, while reseau backlight 1219 iUuminates the reseau 

1205. Alternatively, object image 1204 can be illuminated 
by object image frontlight 1218. 

Hie frame and the supporting structure for the lens 1209, 
mirrors 1241, 1243, 1245, 1251, 1253, and 1255, and 
photoreceptor arrays 1215 and 1211 are not shown in the 
diagrammatic view of FIG, 12, but they can be constructed 
by persons skilled in this art, once the principles of this 
invention are understood from the description above. The 
methods and materials for constructing a frame and optical 
supporting stmcture for this embodiment of scanner 1212 
are well known in the art. In FIG. 12, the object image 1204 
and reseau 1205 are fixed in a rigid position by such a frame. 
Likewise, lens 1209, mirrors 1241, 1243, 1245, 1251, 1253, 
and 1255, and photoreceptor arrays 1211 and 1215 are 
rigidly fixed within the frame. Photoreceptor arrays 1211 
and 1215 are held in a fixed and immovable position by 
assembly-block 1230. 

Mirror 1246 is positioned such that light rays emanating 
from reseau backlight 1219 and passing through reseau 1205 
reflect off of mirror 1246 in such a direction that they pass 
through lens 1209, reflect off of mirrors 1251 or 1253, and 
then reflect off of mirror 1255. The light rays reflecting off 
of mirrors 1251 or 1253, and then 1255 are then detected by 
photoreceptor array 1215. Light rays that strike mirrors 
1246, 1251, 1253, or 1255 which do not emanate from 
reseau backlight 1219 are not reflected through lens 1209 
and they are not detected by photoreceptor array 1215. 

Mirrors 1241, 1243, and 1245 are positioned such that 
Ught rays emanating from object image backlight 1217, or 
object image frontlight 1218, and passing through object 
image 1204 reflect off of mirror 1241 in such a direction that 
they pass through lens 1209, reflect sequentially off of 
mirrors 1243 and 1245, and then are detected by photore- 
ceptor array 1211. Light rays that strike mirrors 1241, 1243, 
or 1245 which do not emanate from object image backlight 
1217 or object image frontlight 1218 are not reflected 
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through lens 1209 and they are not detected by photorecep- 
tor array 1211. Using the two photoreceptor segments 1215a 
and 12156 to comprise photoreceptor array 1215 and the 
associated mirrors 1251, 1253, and 1255 provides for the 

5 detection of scanner 1112 rotation as described above in 
relation to FIGS. 7B, lOA, lOB, and 10c. 

Diaphragm 1266 completely blocks some of the light rays 
emanating from reseau backlight 1219 that passes through 
reseau 1205. More specifically, some of the Ught rays that 

10 emanate from backlight 1219 and pass through reseau 1205 
could, upon reflecting off of mirror 1246 and passing 
through lens 1209, be further reflected off of mirrors 1243 
and 1245 and detected by photoreceptor array 1211 instead 
of being reflected off of mirrors 1251 or 1253, then mirror 

15 1255 and then detected by photoreceptor array 1215. Dia- 
phragm 1266 blocks those light rays that emanate from 
reseau backlight 1219 that would otherwise strike mirrors 
1246, 1243, and 1245 and be detected by photoreceptor 
array 1211, if they were aflowed to propagate. Therefore, all 

20 of the light rays emanating from reseau backlight 1219 and 
passing through reseau 1205 and diaphragm 1266 reflect off 
' of mirror 1246, pass through lens 1209, reflect off of mirrors 
1251 or 1253, reflect off of mirror 1255, and are detected by 
photoreceptor array 1215. Diaphragm 1166 also ensures that 

25 extraneous or spurious light rays that might otherwise strike 
mirrors 1243, 1245, 1251, 1253, or 1255, or pass through 
lens 1209 are not allowed to propagate into scanner 1212. 

In a similar manner to diaphragm 1266, diaphragm 1268 
completely blocks some of the hght rays that emanate from 

30 object image backlight 1217 and pass through object image 
1204. This diaphragm 1268 ensures that only light rays that 
emanate from object image backlight 1217 and pass through 
object image 1204 that will strike mirror 1241 are allowed 
to propagate into scaimer 1212 and that extraneous or 

35 spurious light rays that might otherwise strike mirrors 1243, 
1245, 1251, 1253, or 1255 or pass through lens 1209 are not 
allowed to propagate into scanner 1212. 

Like the photoreceptor arrays 211 and 215 discussed 
above, each photoreceptor element M) 212 in the photore- 

40 ceptor array 1211 and the photoreceptor array 1215 gener- 
ates an electric signal in proportion to the amount of Ught 
detected by the photoreceptor element 212. The signals 
generated are analyzed and processed in a similar manner as 
that discussed above. 

45 The previoxis discussion has described the use of a reseau 
105 that is scanned either simultaneously with the object 
image 104 to detect both the repeatable and the random 
errors in the position and attitude of the scan head 101, or 
sequentially before the object image 104 is scanned to assess 

50 only the repeatable error in the position and attitude of the 
scan head 101. If only the repeatable errors are detected, a 
random or residual error may be left undetected which might 
distort the final digital image. The following procedure is 
preferably used to detect any random or residual error and 

55 remove it from the final digital image. The procedure is 
typically implemented in a "post-processing" step, using 
previously collected pixels which are kept in a buffer 
memory, processed, and only then transferred as a final 
output to the user's host computer. 

60 More specifically, in afl of the embodiments previously 
discussed, it is possible for adjacent swaths 225, 225', 225" 
to overlap, as shown in FIG. 18, to create areas of overlap 
1808, 1810. Hie sizes of the swaths 225,225', 225" and the 
scan lines 221, 221', 221*' are exaggerated in FIGS. 18-22 

65 for purposes of fllustration. Now referring to FIG. 18, during 
scanning of the object image 104, the scan line 221 moves 
in the raster path 222 (see FIG. 2 also) to create a swath 225 
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bordered by the dashed lines 1800, 1804, Likewise, the 
adjacent scan line 221' moves in the raster path 222' to create 
another swath 225' bordered by the dashed lines 1802, 1806, 
and the scan line 221" moves in the raster path 222" to create 
still another swath 225" bordered by the dashed lines 1807, 
1809, An area of overlap 1808 is formed between the dashed 
lines 1802, 1804 that is scanned twice — ^first, during move- 
ment of the scan head 101 in the raster path 222 to form the 
swath 225 and a second time during the movement of the 
scan head 101 in the raster path 222' to form the swath 225'. 
Similarly, an area of overlap 1810 is formed between the 
dashed lines 1807, 1806 that is scanned twice — , first, during 
movement of the scan head 101 in the raster path 222' to 
form the swath 225' and a second time during the movement 
of the scan head 101 in the raster path 222" to form the swath 
225". 

When the area of overlap 1808 occur, redundant image 
information is created in the overlap 1810 that can be used 
to align the image generated by the swath 225' with the 
image generated by the previous swath 225. Likewise, 
redundant image information is created that can be used to 
align the image generated by the swath 225" with the image 
generated by the previous swath 225', and so for all of the 
swaths created by movement of the scan head 101. Such 
redundant image information, however, could create visible 
errors in the final output image, if errors are not removed. 

Hie optional alignment process is especially useful in 
obtaining seamless images when the object image 104 has 
been scanned without a simultaneous scanning of the reseau 
105. When the object image 104 and the reseau 105 are 
scanned simultaneously, as described above, the alignment 
process may not be required due to the accuracy of the 
determination of the repeatable and the random errors, and 
the redundant image iniformation may simply be discarded 
as the final image is being created. 

Hie alignment process, which, as mentioned above, is 
useful especially when there is not a simultaneous scanning 
of the reseau, comprises three major steps, as will be 
discussed in more detail below. Referring now primarily to 
FIG. 19, with continuing secondary reference to FIG. 18, the 
first step is, in general, an image matching process per- 
formed on the swaths 225, 225' to find one or more distinc- 
tive points e.g., Qj, Q^, Q3, in the area of overlap 1808 that 
is part of one or more distinct feature or features (for 
example 1860, 1862, 1864 respectively) of the scarmed 
object image 104 in the swath 225 that are identical or 
approximately identical to the same point or points, i.e., Q', 
Qi'j Ozj of same distinct feature or features (for example 
I860', 1862', 1864') of the object image 104 that are in the 
swath 225'. When the image matching process finds such 
corresponding points, e.g., Q, Q^, Q^, for features 1860, 
1862, 1864 detected in swath 225 of the object image 104 
that are identical or nearly identical to the corresponding 
points, e.g., Q', Q/, Q2', of those features, e.g., I860', 1862', 
and 1864', detected in and the overlap portion 1808 of the 
swath 225' such point or points Q^, Q^, Q3 and Qj', Q2', Q3' 
are used to align the image generated by the scan line 221' 
with the adjacent image generated by the scan line 221. The 
redundant pixels from the swath 225' for the area of overlap 
1808 are then eliminated from the final output image. 

The. procedure used to detect corresponding pairs of 
points such as Q, Q' is called "image matching", "image 
registration", or "image correlation" and is a process amply 
documented in the literature on image processing, image 
warping, computer vision, or image pattern recognition. As 
image matching is well known to persons having ordinary 
sldll in the art, a complete discussion is not necessary for 
purposes of present invention. 
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However, for an overview or primer, the scanning process 
is set up in such a way that the area of overlap 1808 occurs 
and that the area of overlap 1808 is preferably several 
hundred pixels Avide. The image generated by the swath 225' 

5 can be aligned with the adjacent image generated by the 
swath 225. For this purpose, the errors detected by the 
redundant image information and by the image matching 
process leading to the pairs of points Q, Q' and/or Q^, Q^' 
and/or Qj, Qj' can be reduced and possibly eliminated by the 

10 following example process. 

As previously discussed, points Q, Q^, Q2 detected in the 
area of overlap 1808 created by the swath 225 are found, 
which are image matched to corresponding points points Q', 
Qi', Q2 in the area of overlap 1808 created by the swath 

15 225'. Each point Q Q^, Q2 will, therefore, have a corre- 
sponding point Q', Qj', Q2', and vice versa. In other words, 
the point corresponds to the point Qj', the point Q2 
corresponds to the point Qj, etc. The number of pairs of 
corresponding points Q/Q', and, therefore, their density in 

20 the area of overlap 1808, will depend on the desired 
accuracy, the type of image being scanned, and the required 
speed or throughput of the scanning process. 

The first step results in a table of match points that 
contains the differences in the gray values for the image 

25 matched points and the differences in the X and Y coordi- 
nates for each location of a point Q', Q-^', . For example, 
the difference in the gray values for the points Qj and Qj' as 
well as the differences between the X,Y coordinates for the 
points Qi and Q^' are stored in the table. Therefore, the table 

30 contains AX, AY, and Agray values for each point Q'. For 
Ql', the AXj value is equal to X^j^gi', the AYj value is 
equal to Y^i-Ygj', and the Agray value is equal to gray 
value^i-gray value^j.. It should be noted that for purposes 
of illustration and explanation, the positional errors between 

35 the points Q and Q' are exaggerated in FIG. 19. The actual 
positional errors between the points Q and Q* are, in reality, 
extremely small, namely only in the range of the residual 
effects of random, non-repeatable errors of the scan head's 
101 position and attitude. The table is created for the entire 

40 area of overlap 1808 and will grow with each new scan line 
for the swath 225'. 

As previously discussed, the movement of the scan head 
101 and the imaging of the pixels of the object image 104 in 
the raster path 222 by the photoreceptor array 221 (see FIG. 

45 20) creates the swath 225 with a series of adjacent scan lines 
1807^1, 1807^, 1807c, ISiyjd, etc. Likewise, the movement 
of the scan head 101 and the imaging of the pixels of the 
object image 104 in the raster path 222' by the photoreceptor 
array 221 (see FIG. 20) creates the swath 225' with a series 

50 of scan lines 1809fl, 1809fc, 1809c, lSQ9d, etc. The scan 
lines 1807a-1807d overiap the scan lines 1809-1809£f, etc., 
imperfectly due to residual errors of the scan head's 101 
position and attitude, as shown in FIG. 20. 
TTie table of AX, AY, and Agray values will now be used 

55 to accomplish the aligmnent of the scan lines and the swaths 
225, 225' by appl5dng a transformation of each scan line in 
the 3 swath 225'. For example, the scan line 1809a in the 
swath 225' is aligned to the scan line 1807a in the swath 225 
, the scan line 18096 in the swath 225' is aligned to the scan 

60 line 1807i> in the swath 225', etc. Since the alignment 
process is identical for each scan line in the swath 225', only 
the alignment of the scan line 1809a will be discussed in 
further detail 

Refening again to FIG. 20 and also to FIG. 21, the pairs 
65 of points Q,Q' in the area of overlap 1808 are used to aUgn 
the scan line 1809a with the scan line 1807a. For the 
example of aligning the scan line 1809a with the scan fine 
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1807fl, the pair of points Qq in FIG. 21, Qq arc used. Point 
Qq is chosen for use for the alignment of the scan line 1809a 
with the scan line 1807a since the point Qq' falls on the scan 
line 1809a (see FIG. 21). Normally, however, the overlap of 
scan lines in the area of overlap 1808 will not contain any 
image matched points Q,Q' for the particular scan line being 
aligned. In which case, an interpolation process must be 
used to interpolate the AX, AY, Agray values from the 
surrounding image matched points Q^-, Q/ where i=l, 2, etc. 
For example, if point Qq' did not exist, the AX, AY, Agray 
values would be computed using the surrounding values for 
Q4', Q5 » Qef O7, Qs and any other surrounding points Q' 
contained in the table of matched points. Interpolation 
procedures are well-established and well-known mathemati- 
cal tools, and a great number of such procedures are being 
used in many different applications. The to present 
invention, which seeks to compute values for AX, AY, Agray 
at a location Qq on the scan hne 1809a using known values 
for AX, AY, Agray at other locations Q4' to Q g IS an 
appropriate application of interpolation common techniques. 
Great care must be taken, however, in cases where "inter- 
polation" becomes "extrapolation" when, for example, there 
are no entries in the table of matched points for one side of 
the scan line 1809fl. Such occurrence can be encountered 
when, for example, the image is empty and no distinctive 
prints or features can be found for image matching. 
Fortunately, in such a case where no distinctive prints or 
features can be found for image matching, the discrepancies 
between the swaths 225, 225' become invisible, anyway, i.e., 
for the final digital image to show a visible defect, there must 
be a recognizable or distinctive feature in the area of overlap 
1808 between the swath 225 and the swath 225'. 

As a result of this step of the alignment procedure, the AX, 
AY, Agray values for the point Qq', determined either 
directly from the table of matched points or by interpolation, 
are used to align the scan line 1809a with the scan line 1807a 
and are used to project the pixels 1816 in the scan line 1809a 
onto the scan line 1809a' (see FIG. 22). More specifically, 
the alignment is accompUshed by holding the end 1812 of 
the scan line 1809a fixed and projecting the pixel on the scan 
line 1809a containing the point Qq such that the X,Y 
coordinates for the pixel on the scan line 1809fl containing 
the point Qq are adjusted by AX, AY so that Qq' aligns with 
Qq. In addition, the gray value for the pixel containing the 
point Qo' is adjusted by liie Agray value so that the points Qq, 
Qq' have identical gray values. 

This aligrmienl of an individual scan line 1809a is being 
accomplished by a "forward sampling** process, which is 
similar to the forward sampling process previously 
described in the EIGS. 15a and ISb and the associated text. 
For each of the pixels of the scan line 1809a, that is, for each 
pixel from the end 1812 (which is not changed) to the end 
1814 (which is changed the most), the X, Y, gray value 
changes are known since they are linearly interpolated and 
derived from AX=0, A/Y=0, Agray^O at the end 1812 and 
the AX, AY, Agray values for the point Qq' on the scan line 
1809a. In this manner, the scan line 1809a is used to create 
gray values in the output image pixel array from the dashed 
hne 1804 to the dashed line 1806 m the swath 225'. 

After the projection (forward sampling) process is 
complete, the output scan line 1809fl' of the final digitized 
copy of the object image 104 may be longer (as shown in 
FIG. 22) or shorter than the input scan line 1809a All pixels 
belonging to the scan line 1809a' that do fall within the area 
of the object image 104 defined by the lines 1802, 1806 are 
deleted by the image transform computer 346. The output 
image has now been filled in with output pixels up to and 
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including scan line 1809a'. The process is now repeated for 
each scan line in the swath 225' imtil the swath 225' is 
completed. After the swath 225' is completed, the scan head 
101 is displaced laterally to begin a new swath 225" extend- 

5 ing from the dashed line 1807 to the dashed line 1809 (see 
FIG. 18). The same procedure discussed above, i.e., image 
matching, error interpolation, and forward sampling, can be 
repeated to aUgn the scan lines in the swath 225" with the 
scan lines in the swath 225' using the area of overlap 1810. 

10 Another embodiment of the present invention uses a job 
sheet to enhance error correction during scanning of an 
object image, particularly the correction of random errors 
that occur during scanning of the object image. Random 
errors can be created by mechanical limitations of the 

15 scanning device and wiQ often include errors that arc not 
repeatable or that cannot be easily removed by simultaneous 
or sequential scanning of a reseau and an object image. 

A job sheet is a transparent or semi-transparent sheet or 
thin film 3000 on which markings 3002 are placed, as best 

20 illustrated in FIG. 23. The markings 3002 are preferably 
crosses, but can be squares, circles, angles, dots, etc. Crosses 
are preferred for the markings since crosses will provide a 
high degree of contrast for detection by photoreceptors. 
The position of each of the markings 3002 on the job sheet 

25 3000 is preferably known and stored in memory (not 
shown), either from previous scans of the job sheet, previous 
measurement of the markings with a coordinate measuring 
device, manufacturing specifications, etc. Therefore, abso- 
lute distances between markings can be determined. 

30 Hundreds, thousands, or millions of markings may exist on 
a single job sheet. The markings 3002 on the job sheet 3000 
preferably form a geometric and repeating pattern. 

Duriug use of the job sheet 3000, an object image 3004 to 
be scanned is placed on or in the same plane as the job sheet 

35 3000, as best illustrated in FIG. 24. The object image 3004 
preferably does not completely cover the job sheet 3000 
such that markings 3002 are viewable or scannable outside 
the periphery of the object image 3004. In addition, the job 
sheet 3000 preferably does not interfere or cover up any of 

40 the object image 3004. The object image 3004 and the job 
sheet 3000 can, in essence, be considered as a single object 
image 104 to be scanned in accordance with any of the 
methods or structural embodiments previously described 
above. 

45 During scanning of the object image 3004 and the job 
sheet 3000, the object image 3004 and the job sheet 3000 are 
scanned simultaneously as previously described for an 
object image 104. Preferably, photoreceplor(s) (not shown) 
scanning the object image 3004 and the job sheet 3000 are 

50 located such that either the object image 3004 and the job 
sheet 3000 are located in the same scanning plane or the 
object image 3004 is between the job sheet 3000 and the 
photoreceplor(s). In addition, the object image 3004 and the 
job sheet 3000 are preferably illuminated from the object 

55 image 3004 side of the object image 3004yjob sheet 3000 
combination, which may be on the same side of the object 
image 3004 and the job sheet 3000 as the photoreceptor's). 

The object image 3004 and the job sheet 3000 may be 
scanned by multiple swaths, as described above or as 

60 indicated by the arrows/paths 3006, 3008, using a linear or 
non-linear array (represented by the rectangle 3010). During 
scanning of the object image 3004 and the job sheet 3000, 
different or varying errors in position and attitude of a scan 
head, such as the scan head 101 (FIG. 1), may occur during 

65 each scan swath. 

If a reseau is used cither prior to or diu'ing the scan of the 
object image 3004 and the job sheet 3000, a preliminary 
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correction or calibration of the resulting image can be 
created as previously described above. A resultant digital 
image of both the object image 3004 and the job sheet 3000 
is then created. Distortions in the digital image can be 
computed or otherwise determined by computing positions 
and distances between markings 3002 on the job sheet 3000 
as they appear in the resultant image. Since the true positions 
of the markings and the distances between adjacent mark- 
ings on the job sheet 3000 are known and stored, the extent 
and value of the geometric distortions can be determined for 
each swath of the combination object image 3004 and job 
sheet 3000. Correction of the resultant digital image or 
individual swaths of the resultant digital image can be 
performed using geometric and photogrammetric 
techniques, such as resampling, including those techniques 
previously described above. In addition, correction of the 
resultant digital image using information from the scan of 
the job sheet 3000 can be done simultaneously with correc- 
tion of the resultant digital image using information from a 
prior or simultaneous scan of a reseau. 

Another embodiment of a scanning apparatus designed in 
accordance with the present invention is illustrated in FIG. 
25. The scanning device 3050 includes a light source 3052 
or lamps 3053 that illuminate a object image 3054, a 
diaphragm 3056, a focusing mirror 3058 that n can move in 
the direction indicated by the arrow 3060, a movable lens 
3062 that can shift or move between positions 3064, 3066, 
and minors 3068, 3070 that reflect light toward the photo- 
receptor 3071. 

Moving the lens 3062 from position 3064 to the position 
3066 docs not change light path 3072, but it does change the 
order in of the lens 3062 and the minors 3068, 3070 in the 
hght path 3072, thereby changing resolution of the image 
received by the photoreceptor 3071. Therefore, by flipping 
or otherwise moving the lens 3062 from position 3064 to 
position 3066, resolution- of the resulting image can be 
altered without any further changes in hardware or software. 
For example, assuming the mirrors 3060, 3068, 3078 and the 
lens 3062 are designed such that dual native optical resolu- 
tions are possible, resolution might be switching between 
5000 dots per inch and 868 dots per inch simply by flipping 
or moving the lens 3062 between the positions 3064, 3066. 

With the image matching element of the scanning process, 
it is now possible to operate the scaiming apparatus 100 in 
various different modes. In the first mode, the reseau 105 is 
scanned simultaneously with the object image 104 and 
positional and attitude errors in the scan head 101 are 
corrected on the fly and image matching is not used. In the 
second mode, the JD reseau 105 is scanned simultaneously 
with the object image 104 and positional and attitude errors 
in the scan head 101 are corrected on the fly and image 
matching is used as an extra safeguard and quality assiuance 
feature to further increase the accuracy of the scanning 
apparatus 100. In the third mode, the reseau 105 is not being 
scanned simultaneously with the object image 104. Instead, 
the reseau 105 is being employed only occasionally for 
calibration purposes to detect and compute the repeatable 
errors in the scan head's 101 position and attitude. Image 
matching is not being used. The reseau 105 is employed in 
the plane of the object image 104, thus reducing the cost and 
complexity of the scanning apparatus 100 by eliminating 
additional photoreceptors, lenses, illumination elements, 
processing circuitry, etc. In the fourth mode, which is 
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. substantially identical to the third mode, image matching is 
used to increase the accuracy of the scanning apparatus 100 
and improve the quality assurance. In the fifth mode, a job 
sheet is used to determine position and/or attitude errors for 
^ the scan head during imaging or scanning of an object 
image. The job sheet can be used each time an object image 
is scanned or just periodically for calibration of the scan 
head. A reseau and/or image matching can be used in 
conjunction with the job sheet, but are not absolutely 
needed. 

Other modes of operation become feasible by saving 
computer processing time if the processes applied to pixels 
and processes addressing coordinates are intelligently sepa- 
rated. For example, the forward sampling of a scan line to 
remove the effects of repeatable error of the scan head 101 
and forward sampling to remove errors found by image 
matching can be combined into a single forward sampling 
process. 

20 While the invention has been particularly shown and 
described with reference to a preferred embodiment thereof, 
it will be understood by those skiUed in this art that various 
changes and modifications in form and details may be made 
therein without departing from the spirit and scope of the 

25 invention according to the following claims. 
What is claimed is: 

1. Image scanning apparatus for scanning and digitizing 
an object image, comprising: 

a job sheet having a plurality of optically detectable 
-^^ markingis in shapes from which distinct points on said 
job sheet are locatable, said job sheet being positioned 
adjacent said object image in such a manner that the 
markingis do not cover or obscure any part of the object 
image that is to be digitized; 

an object photoreceptor array comprising a plurality of 
photoreceptors in fixed spatial relation to each other 
and positioned adjacent, but spatially separated from, 
the object image and the job sheet and mounted in the 
image scanning apparatus in such a manner that por- 
^ tions of the object image and portions of the job sheet 
are focusable optically on photoreceptors in the object 
photoreceptor array and the photoreceptors are capable 
of converting pixels of the object image and job sheet 
to image electrical signals; 

a carrier capable of holding said object photoreceptor at 
and moving said object photoreceptor array relative to 
the object image and the job sheet in a plurality of 
adjacent, partially overlapping swaths comprising pix- 
els of the object image and job sheet in such a manner 
that the pixels of the object image and job sheet get 
focused on the first photoreceptor array and converted 
to image electrical signals; and 

a signal processing circuit that is capable of discerning 
from the image electrical signals distinct points in the 
job sheet and/or the object image and of matching such 
distinct points in overlapping portions of the swaths, 
quantifying apparent spatial mismatches between the 
specific matching distinct points in the overlapping 
portions of the swaths adjusting relative locations of 
pixels in one of the swaths to eliminate such apparent 
spatial mismatches. 

2. The image scanning apparatus of claim 1, wherein at 
least two of said plurality of adjacent, partially overlapping 

65 swaths are parallel. 

3. Hie image scanning apparatus of claim 1, including a 
reseau positioned spatially separated fi:om the object image 
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and job sheet, and including a reseau photoreceptor array 
positioned adjacent, but spatially separate from, said reseau. 

4. The image scanning apparatus of claim 3, wherein said 
reseau photoreceptor array is held by said carrier such that 
when said object photoreceptor array is movable relative to 
said object image and said job sheet, said second photore- 
ceptor is movable relative to said reseau. 

5. The image scanning apparatus of claim 1, wherein said 
object photoreceptor array includes a linear array of the 
photodetectors. 

6. The image scanning apparatus of claim 1 including a 
lens positioned between said object image, said job sheet, 
and said object photoreceptor array and held by said carrier 
such that when said object photoreceptor array is moved 
relative to said object image and said job sheet, said lens is 
moved relative to said object image and said job sheet. 

7. The image scanning apparatus of claim 1, wherein the 
signal processing circuit includes a memory wherein infor- 
mation representative of the object image and the job sheet 
can be stored. 

8. A method of scanning an object and storing pixel 
signals representative of an image of the object using a 
scanning device, comprising: 

positioning a job sheet adjacent the object, with the job 
sheet containing markings in shapes from whidi dis- 
tinct points on the job sheet can be identified and 
located; 

scanning the object and the job sheet in successive 
partially overlapping swaths to produce electrical sig- 
nals representing pixels of the image of the object and 
of the markings of the job sheet; 

identifying distinct points in the job sheet from the 
markings in overlapping portions of the swaths and 
matching the distinct points identified from one of the 
partially overlapping swaths to the same distinct points 
from another one of the overlapping swaths; 

deriving error values representing position errors of the 
scanning device from apparent spatial differences in 
location of the matching distinct points in the swaths; 

adjusting said electrical signals representing pixels of the 
planar object with said error values; and 

storing pixel signals representing said adjusted electrical 
signals representing pixels of the planar object in a 
memory. 

9. The method of claim 8, wherein said scanning of the 
planar object and the job sheet includes scanning said planar 
object in at least overlapping swaths. 

10. The method of claim 9, wherein, said adjusting said 
electrical signals representing pixels of the planar object and 
the job sheet with said error values includes image matching 
two of said overlapping swaths. 

11. The method of claim 9, including determining actual 
spatial locations of the distinct points on the job sheet and 
storing information regarding the actual spatial locations of 
the distinct points on the job sheet in memory. 

12. The method of claim 11, wherein said markings have 
a cross shape. 

13. The method of claim 11, including using information 
in the memory regarding the actual spatial locations of the 
distinct points on the job sheet to correct distortions in said 
electrical signals by: 

determining apparent differences between the actual spa- 
tial locations of the points of the job sheet and apparent 
spatial locations of the same points from the swaths; 
and 
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deriving the error values using differences between the 
apparent locations of the distinct points of the job 
sheets from the swaths and the actual locations from the 
memory. 

5 14. A method of scanning and storing pixel signals 
representative of an object image using a scanning device, 
comprising: 

scanning the object image and a job sheet positioned 
adjacent said object image, wherein said object image 
and said job sheet are located in a first scanning plane, 
to produce electrical signals representing said object 
image and said job sheet; 

supplying position signals representing coordinates of the 
j5 scaiming device relative to said first scaiming plane; 

determining repeatable position and attitude error of the 
scanning device; 

adjusting said electrical signals representing the object 
image and said job sheet with said position signals by 
20 forward sampling to remove effects created by said 
repeatable position and attitude eaor; and 

storing pixel signals representing said adjusted electrical 
signals representing the object image in a memory. 

15. The method of claim 14, wherein said scanning of the 
^ object image and the job sheet occurs simultaneously with 

scanning of a reseau. 

16. The method of claim 14, wherein said scanning of the 
object image and the job sheet includes scanning the object 

30 image and the job sheet in at least two overlapping swaths. 

17. The method of claim 16, wherein said adjusting of 
said electrical signals representing the object image with 
said position signals includes image matching two of said 
overlapping swaths. 

18. The method of claim 17, wherein said image matching 
includes identification of features in said two overlapping 
swaths that are approximately identical. 

19. Image scanning apparatus for scanning and digitizing 
an object image, comprising: 

photoreceptor means positioned adjacent, but spatially 
separated from an object image and a job sheet 
mounted in the image scanning apparatus for scanning 
the object image and the job sheet and converting 
45 pixels of the object image and the job sheet to image 
electrical signals; and 

carrier means for holding said photoreceptor means and 
for moving said photoreceptor means relative to said 
object image and said job sheet. 
50 20. Image scanning apparatiis for scanning and digitizing 
an object image, comprising: 

a job sheet positioned adjacent the object image; 

a first photoreceptor positioned adjacent, but spatially 
separated from the object image and the job sheet; 

a reseau; 

a second photoreceptor positioned adjacent, but spatially 

separated from, said reseau; and 
a carrier capable of holding said first photoreceptor and 
60 said second photoreceptor in fixed spatial relationship 
to each other and for moving said first photoreceptor 
and said second photoreceptor relative to the reseau and 
„relative to the object image, wherein said first photo- 
receptor is oriented such that, during scanning of said 
65 object image and said job sheet by said first 
photoreceptor, light detected by said first photoreceptor 
does not pass through or reflect off of said reseau prior 
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to being detected by said first photodetector, and further 
wherein said second photoreceptor is oriented such 
that, during said scanning of said reseau by said second 
photoreceptor, light detected by said second photore- 
ceptor does not pass through or reflect off the object 5 
image prior or the job sheet prior to being detected by 
said second photoreceptor. 
21. A photogrammetric apparatus comprising: 

a planar object to be scanned for digital storage; 
a job sheet to be scanned simultaneously with the planar 
object; 

a reseau to be scanned simultaneously with the planar 
object; 

a light source positioned such that said planar object, said 
job sheet, and said reaseau are illuminated; 
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a reseau photoreceptor capable of converting an image of 
the reseau focused thereon to reseau electrical signals; 

a planar object photoreceptor distinct from said reseau 
photoreceptor and capable of converting an image of 
the planar object and the job sheet focused thereon to 
object electrical signals; and 

optics capable of focusing light produced by said light 
source means when said light source illuminates the 
reseau, the job sheet, and the planar object such that 
images are formed of the reseau onto the reseau pho- 
toreceptor and images of the planar object and the job 
sheet are formed onto the planar object photoreceptor 
means. 
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